-- Logs begin at Mon 2022-09-26 17:00:36 UTC, end at Mon 2022-09-26 18:29:00 UTC. -- Sep 26 17:54:06.672211 dv-cinder-859319-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 26 17:54:06.679615 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 26 17:54:06.682771 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 17:54:06 2022] *** Sep 26 17:54:06.682771 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 17:54:06.682771 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 17:54:06.682771 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: nodename: dv-cinder-859319-1-iscsi Sep 26 17:54:06.682771 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: machine: x86_64 Sep 26 17:54:06.682771 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: clock source: unix Sep 26 17:54:06.682771 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: pcre jit disabled Sep 26 17:54:06.682771 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: detected number of CPU cores: 4 Sep 26 17:54:06.682771 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: current working directory: / Sep 26 17:54:06.682771 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: detected binary path: /usr/bin/uwsgi-core Sep 26 17:54:06.682771 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: your processes number limit is 47680 Sep 26 17:54:06.683401 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: your memory page size is 4096 bytes Sep 26 17:54:06.683401 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: detected max file descriptor number: 2048 Sep 26 17:54:06.683401 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: lock engine: pthread robust mutexes Sep 26 17:54:06.683401 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: thunder lock: enabled Sep 26 17:54:06.683401 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 26 17:54:06.683401 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 17:54:06.722767 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: Python main interpreter initialized at 0x557ab65999c0 Sep 26 17:54:06.722767 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: python threads support enabled Sep 26 17:54:06.722767 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: your server socket listen backlog is limited to 100 connections Sep 26 17:54:06.722767 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: your mercy for graceful operations on workers is 90 seconds Sep 26 17:54:06.723349 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 17:54:06.723349 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: *** Operational MODE: preforking *** Sep 26 17:54:06.723571 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: *** uWSGI is running in multiple interpreter mode *** Sep 26 17:54:06.723571 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: spawned uWSGI master process (pid: 105762) Sep 26 17:54:06.723666 dv-cinder-859319-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 26 17:54:06.729940 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: spawned uWSGI worker 1 (pid: 105763, cores: 1) Sep 26 17:54:06.729940 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: spawned uWSGI worker 2 (pid: 105764, cores: 1) Sep 26 17:54:06.729940 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 17:54:07.393936 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 17:54:07.433033 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 17:54:08.488915 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 17:54:08.488915 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: from cryptography.utils import int_from_bytes Sep 26 17:54:08.489557 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 17:54:08.489557 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: from cryptography.utils import int_from_bytes Sep 26 17:54:08.502970 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 17:54:08.502970 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: from cryptography.utils import int_from_bytes Sep 26 17:54:08.503410 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 17:54:08.503410 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: from cryptography.utils import int_from_bytes Sep 26 17:54:10.995743 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 17:54:10.996373 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 17:54:10.996669 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 17:54:10.997031 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 17:54:10.997123 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 17:54:10.997485 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 17:54:10.997570 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 17:54:10.997657 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:10.997816 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 17:54:10.997965 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:10.998182 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 17:54:10.998283 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:10.998440 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 17:54:10.998582 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:10.998829 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:10.998919 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:10.999156 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:10.999239 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:10.999478 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:10.999578 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:10.999836 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:10.999931 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.000161 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.000263 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.000416 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.000504 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.000727 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.000821 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.001046 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859319-1-iscsi {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.001136 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.001365 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.001454 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.001636 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.001734 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.001953 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.002046 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.002264 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.002352 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859319-1-iscsi {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.002563 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.002652 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.002874 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.002956 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.003173 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.003261 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.003490 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.003687 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.004961 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.004961 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.005183 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.005321 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.005450 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.005450 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.005688 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.005826 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.005943 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.006073 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.006198 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.006324 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.006452 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.006571 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.006696 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.006900 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.007028 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.007150 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.007278 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.007414 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.007543 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.007683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859319-1-iscsi {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.007816 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.007932 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.008062 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.008192 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.008318 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.008438 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.008568 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859319-1-iscsi {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.008688 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.008845 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.009550 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.009681 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.009851 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.010017 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.010140 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.010437 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.010538 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.010747 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.010836 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.011054 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.011183 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.011375 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.011508 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.011716 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.011846 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.012027 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.012149 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.012325 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.012456 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.012628 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.012753 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.012933 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.013056 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.013490 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.013629 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.013798 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.013947 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.014096 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.014219 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.014344 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.014476 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.014630 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.014761 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.014944 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.015075 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.015257 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.015383 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.015502 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.015630 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.015832 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.015963 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.016095 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.016216 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.016376 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.016504 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.016690 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.016832 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.016993 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.017123 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.017266 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.017389 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.017583 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.017714 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.017884 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.018014 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.018184 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.018314 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.018482 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.018607 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.018782 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.018905 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.019083 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.019212 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.019387 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.019518 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.019706 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.019841 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.020007 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.020137 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.020308 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.020431 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.020621 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.020744 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.020931 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.021063 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.021243 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.021366 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.021543 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.021677 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.021856 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.021987 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.022183 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.022315 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.022485 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.022616 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.022788 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.022922 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.023103 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.023231 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.023403 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.023525 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.023726 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.023874 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.024032 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.024157 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.024347 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.024495 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.024707 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.024903 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.025033 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.025222 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.025351 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.025479 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.025607 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.025757 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.025917 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.026048 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.026224 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.026347 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.026475 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.026648 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.026774 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.026950 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.027074 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.027251 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.027386 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.027545 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.027727 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.027862 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.027989 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.028155 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.028291 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.028455 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.028585 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.028754 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.028879 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.029054 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.029190 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.029354 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.029478 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.029650 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.029773 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.029949 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.030075 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.030249 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.030373 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.030550 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.030678 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.030851 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.030981 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.031158 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.031281 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.031456 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.031589 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.031781 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.031913 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.032115 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.032243 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.032363 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.032483 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.032666 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.032791 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.032967 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.033149 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.033273 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.033391 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.033564 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.033688 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.033863 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.033986 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.034163 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.034287 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.034471 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.034597 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.034770 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.034894 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.035070 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.035200 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.035380 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.035503 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.035695 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.035832 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.035997 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.036121 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.036309 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.036431 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.036607 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.036739 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.036907 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.037044 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.037206 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.037329 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.037506 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.037629 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.037805 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.037935 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.038106 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.038235 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.038403 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.038532 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.038703 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.038843 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.038992 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.039113 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.039297 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.039428 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.039599 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.039755 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.039923 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.040545 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.040736 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.040860 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.041038 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.041162 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.041351 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.041486 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.041681 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.041806 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.042008 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.042133 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.042346 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:54:11.042468 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.042653 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.042775 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.042981 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.043130 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.043301 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.043433 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.043615 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.043792 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.043948 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.044082 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.044257 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.044392 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.044576 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.044708 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.044882 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.045014 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.045192 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.045315 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.045498 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.045630 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.045811 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.045934 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.046121 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.046243 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.046434 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.046574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.046745 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.046868 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.047059 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.047183 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.047369 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.047499 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.047697 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.047838 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.048016 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.048149 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.048339 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.048474 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.048654 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.048785 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.048959 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.049089 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.049294 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.049427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.049611 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.049733 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.049920 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.050045 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.050238 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.050363 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.050556 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.050680 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.050863 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.050993 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.051171 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.051296 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.051477 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.051608 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.051846 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.051969 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.052157 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.052288 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.052451 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.052581 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.052767 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.052896 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.053073 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.053207 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.053390 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.053514 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.053699 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.053897 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.054021 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.054141 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.054301 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.054423 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.054608 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.054739 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.054916 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.055040 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.055225 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.055347 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.055539 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.055847 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.056537 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.056656 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.056846 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.057043 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.057168 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.057360 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.057485 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.057679 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.057810 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.057991 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.058124 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.058302 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.058427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.058612 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.058737 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.058913 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.059046 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.059216 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.059340 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.059518 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.059673 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.059839 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.059974 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.060156 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.060279 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.060466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.060597 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.060773 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.060910 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.061095 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.061219 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.061422 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.061545 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.061727 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.061860 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.062035 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.062159 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.062350 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.062473 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.062658 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.062774 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.062960 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.063084 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.063269 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.063392 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.063576 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.063726 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.063903 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.064039 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.064213 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.064342 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.064517 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.064649 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.064816 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.064939 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.065135 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.065257 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.065434 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.065566 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.065737 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.065862 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.066042 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.066182 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.066399 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.066531 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.066652 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.066759 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.066945 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.067084 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.067250 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.067372 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.067561 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.067714 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.067889 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.068026 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.068196 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.068329 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.068504 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.068635 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.068815 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.068947 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.069122 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.069260 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.069440 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.069564 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.069752 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.069875 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.070063 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.070194 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.070363 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.070487 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.070668 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.070794 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.070967 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.071083 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.071269 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.071453 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.071633 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.071822 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.071949 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.072070 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.072252 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.072556 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.072672 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.072777 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.072890 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.072993 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.073139 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.073272 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.073441 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.073565 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.073742 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.073865 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.074045 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.074182 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.074368 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.074493 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.074665 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.074787 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.074965 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.075097 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.075265 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.075396 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.075566 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.075707 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.075928 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.076066 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.076233 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.076357 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.076556 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.076678 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.076872 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.076997 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.077179 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.077303 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.077493 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.077617 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.077801 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.077934 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.078107 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.078229 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.078414 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.078545 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.078720 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.078852 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.079026 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.079148 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.079329 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.079457 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.079687 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.079843 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.080031 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.080162 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.080291 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.080421 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.080563 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.080689 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.080878 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.081002 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.081178 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.081314 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.081488 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.081612 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.081789 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.081912 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.082104 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.082240 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.082437 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.082560 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.082751 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.082876 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.083056 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.083260 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.083384 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.083503 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.083678 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.083818 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.083998 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.084122 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.084300 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.084423 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.084604 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.084735 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.084911 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.085035 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.085213 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.085336 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.085525 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.085656 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.085830 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.085960 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.086143 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.086272 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.086447 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.086579 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.086759 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.086884 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.087087 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.087224 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.087411 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.087661 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.087803 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.087935 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.088065 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.088194 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.088354 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.088486 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.088685 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.088810 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.088994 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.089119 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.089304 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.089440 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.089626 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.089750 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.089936 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.090067 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.090237 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.090368 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.090540 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.090664 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.090848 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.090970 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.091152 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.091284 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.091457 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.091580 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.091791 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.091931 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.092099 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.092231 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.092409 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.092533 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.092712 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.092836 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.093011 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.093135 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.093310 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.093434 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.093610 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.093733 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.093914 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.094039 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.094220 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.094343 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.094535 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.094664 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.094845 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.094970 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.095143 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.095273 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.095442 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.095574 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.095782 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.095907 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.096085 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.096243 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.096365 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.096503 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.096671 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.096804 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.096970 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.097093 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.097273 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.097413 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.097575 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.097699 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.097886 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.098009 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.098202 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.098339 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.098503 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.098633 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.098814 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.098937 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.099124 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.099249 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.099425 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.099590 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.099764 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.099885 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.100057 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.100182 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.100364 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.100487 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.100667 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.100790 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.100974 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.101098 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.101277 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.101393 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.101581 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.101706 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.101886 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.102018 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.102194 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.102317 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.102501 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.103182 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.103459 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.103582 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.103723 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.103847 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.103966 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.104167 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.104300 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.104481 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.104605 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.104789 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.105075 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.105208 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.105407 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.105532 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.105722 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.105972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.106097 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.106305 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.106430 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.106621 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.106753 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.106942 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.107066 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.107282 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.107423 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.107623 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.107799 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.107921 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.108060 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.108188 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.108320 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.108482 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.108607 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.108783 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.108913 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.109090 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.109215 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.109391 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.109517 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.109692 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.109816 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.109994 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.110120 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.110303 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.110429 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.110603 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.110735 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.110902 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.111034 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.111202 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.111326 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.111503 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.111633 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.111835 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.111971 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.112138 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.112263 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.112441 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.112564 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.112737 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.112873 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.113045 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.113168 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.113347 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.113477 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.113646 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.113781 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.113944 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.114068 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.114241 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.114366 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.114548 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.114678 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.114851 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.114975 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.115155 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.115286 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.115485 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.115609 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.115814 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.115938 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.116130 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.116253 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.116431 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.116556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.116747 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.116871 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.117046 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.117179 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.117346 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.117471 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.117642 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.117770 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.117947 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.118079 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.118296 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.118916 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.119084 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.119295 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.119427 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.119614 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.119761 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.119952 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.120077 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.120259 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.120394 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.120573 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.120698 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.120876 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.120999 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.121175 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.121306 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.121483 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.121603 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.121783 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.121905 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.122086 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.122220 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.122385 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.122517 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.122692 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.122817 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.122996 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.123128 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.123295 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.123427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.123597 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.123769 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.123918 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.124050 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.124228 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.124358 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.124526 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.124650 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.124824 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.124949 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.125120 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.125244 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.125425 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.125549 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.125728 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.125853 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.126024 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.126146 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.126324 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.126447 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.126631 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.126754 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.126930 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.127061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.127228 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.127351 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.127532 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.127680 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.127853 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.127978 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.128150 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.128286 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.128452 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.128574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.128760 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.128885 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.129064 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.129203 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.129360 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.129491 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.129666 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.129796 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.129963 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.130100 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.130263 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.130394 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.130561 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.130685 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.130865 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.131002 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.131163 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.131287 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.131460 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.131583 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.131779 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.131913 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.132084 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.132209 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.132381 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.132504 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.132685 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.132816 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.132986 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.133110 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.133282 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.133411 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.133582 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.133707 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.133889 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.134017 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.134267 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.134464 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.134601 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.134775 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.134899 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.135133 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.135257 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.135437 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.135560 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.135772 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.135907 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.136089 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.136210 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.136414 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.136544 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.136690 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.136819 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.136998 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.137121 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.137299 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.137423 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.137608 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.137730 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.137912 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.138041 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.138212 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.138584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.138765 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.138895 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.139064 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.139187 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.139373 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.139505 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.139703 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.139832 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.140003 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.140136 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.140316 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.140450 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.140628 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.140751 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.140938 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.141074 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.141235 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.141369 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.141542 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.141673 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.141849 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.141985 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.142170 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.142300 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.142461 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.142587 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.142768 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.142899 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.143070 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.143193 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.143374 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.143498 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.143699 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.143847 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.144007 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.144131 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.144309 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.144432 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.144612 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.144738 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.144918 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.145040 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.145221 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.145344 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.145521 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.145646 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.145827 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.145950 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.146132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.146261 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.146431 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.146564 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.146737 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.146863 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.147035 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.147196 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.147320 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.147438 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.147625 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.147774 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.147950 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.148085 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.148259 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.148383 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.148561 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.148699 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.148938 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.149070 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.149245 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.149376 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.149618 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.149821 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.149966 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.150239 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.150366 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.150494 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.150615 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.150716 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.150850 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.150979 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.151107 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.151227 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.151398 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.151523 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.151801 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.151928 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.152106 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.152230 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.152404 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.152571 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.152703 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.152841 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.153007 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.153131 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.153304 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.153434 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.153604 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.153729 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.153904 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.154035 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.154212 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.154342 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.154507 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.154629 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.154806 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.154929 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.155128 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.155266 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.155433 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.155557 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.155774 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.155901 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.156188 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.156325 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.156501 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.156625 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.156803 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.156934 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.157119 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.157252 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.157434 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.157570 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.157751 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.157875 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.158050 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.158174 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.158360 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.158494 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.158668 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.158792 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.158986 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.159110 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.159303 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.159429 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.159607 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.159758 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.159940 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.160066 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.160240 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.160374 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.160553 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.160677 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.160865 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.160988 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.161164 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.161287 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.161476 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.161607 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.161794 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.161917 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.162109 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.162234 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.162429 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.162553 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.162778 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.162909 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.163098 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.163230 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.163399 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.163527 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.163720 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.163865 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.164029 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.164154 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.164328 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.164452 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.164628 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.164760 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.164941 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.165602 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.165844 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.166011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.166198 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.166351 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.166537 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.166670 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.166792 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.166912 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.167040 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.167162 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.167282 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.167402 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.167523 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.167664 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.167823 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.167956 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.168141 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.168272 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.168450 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.168574 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.168765 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.168898 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.169081 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.169206 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.169380 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.169504 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.169695 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.169821 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.170002 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.170126 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.170301 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.170437 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.170600 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.170725 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.170901 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.171032 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.171237 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.171368 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.171537 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.171697 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.171865 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.171991 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.172201 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.172333 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.172504 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.172627 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.172819 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.172942 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.173146 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.173278 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.173464 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.173587 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.173771 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.173901 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.174075 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.174199 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.174389 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.174514 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.174708 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.174832 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.175010 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.175136 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.175309 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.175440 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.175615 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.175759 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.175928 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.176052 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.176224 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.176350 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.176523 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.176647 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.176828 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.176953 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.177127 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.177260 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.177424 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.177557 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.177722 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.177847 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.178023 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.178145 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.178325 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.178455 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.178627 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.178756 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.178939 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.179062 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.179242 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.179374 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.179544 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.179697 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.179867 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.180003 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.180177 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.180312 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.180484 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.180608 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.181379 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.181575 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.181712 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.181842 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.181999 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.182125 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.182319 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.182446 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.182631 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.182757 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.182943 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.183067 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.183255 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.183386 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.183584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.183728 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.183889 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.184015 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.184202 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.184327 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.184510 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.184636 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.184822 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.184946 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.185132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.185256 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.185447 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.185574 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.185790 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.185962 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.186107 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.186286 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.186412 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.186597 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.186908 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.187032 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.187216 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.187348 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.187527 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.187711 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.187859 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.187983 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.188169 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.188306 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.188477 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.188602 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.188783 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.188908 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.189089 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.189215 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.189398 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.189529 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.189710 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.189837 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.190021 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.190153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.190348 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.190471 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.190660 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.190856 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.190980 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.191101 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.191267 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.191391 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.191574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.191730 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.191929 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.192060 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.192244 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.192361 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.192544 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.192668 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.192854 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.192987 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.193164 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.193289 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.193474 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.193600 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.193779 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.193903 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.194084 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.194222 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.194392 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.194519 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.194699 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.194823 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.195004 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.195137 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.195310 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.195434 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.195617 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.195776 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.195947 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.196085 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.196251 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.196920 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.197119 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.197300 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.197605 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.197738 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.197938 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.198063 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.198267 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.198390 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.198582 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.198714 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.198893 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.199095 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.199221 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.199410 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.199542 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.199762 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.200038 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.200163 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.200354 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.200478 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.200686 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.200812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.200999 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.201122 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.201323 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.201447 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.201627 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.201752 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.201929 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.202061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.202244 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.202378 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.202546 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.202677 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.202843 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.202966 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.203150 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.203281 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.203456 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.203579 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.203779 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.203904 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.204097 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.204234 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.204404 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.204528 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.204707 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.204920 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.205044 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.205262 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.205387 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.205572 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.205834 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.205966 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.206182 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.206307 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.206495 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.206626 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.206797 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.206922 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.207113 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.207239 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.207415 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.207539 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.207753 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.207919 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.208078 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.208385 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.208509 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.208692 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.209008 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.209145 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.209316 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.209576 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.209710 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.209911 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.210036 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.210222 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.210349 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.210534 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.210658 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.210843 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.210967 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.211153 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.211279 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.211455 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.211579 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.211804 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.211992 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.212648 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.212825 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.212953 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.213140 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.213266 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.213449 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.213581 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.213762 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.213894 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.214070 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.214194 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.214375 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.214502 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.214680 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.214805 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.214987 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.215120 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.215287 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.215411 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.215591 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.215735 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.215918 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.216043 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.216219 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.216343 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.216531 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.216662 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.216858 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.216988 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.217160 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.217286 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.217471 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.217594 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.217769 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.217906 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.218069 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.218201 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.218377 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.218500 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.218680 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.218810 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.218990 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.219114 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.219296 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.219426 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.219602 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.219788 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.219919 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.220039 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.220265 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.220388 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.220579 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.220789 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.221109 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.221236 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.221432 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.221559 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.221756 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.221878 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.222075 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.222207 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.222378 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.222501 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.222679 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.222804 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.222977 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.223102 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.223265 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.223401 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.223589 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.223735 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.223922 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.224058 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.224230 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.224369 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.224538 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.224661 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.224841 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.224972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.225148 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.225279 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.225453 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.225576 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.225758 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.225882 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.226065 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.226196 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.226369 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.226494 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.226676 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.226799 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.226978 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.227103 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.227283 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.227406 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.227611 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.227795 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.227958 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.228208 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.228300 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.228399 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.228576 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.228678 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.228884 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.228983 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.229195 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.229326 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.229506 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.229594 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.229812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.229900 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.230117 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.230212 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.230422 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.230517 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.230725 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.230811 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.231031 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.231118 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.231350 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.231451 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.231678 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.231768 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.231979 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.232087 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.232289 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.232657 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.232957 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.233056 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.233267 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.233353 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.233584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.233672 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.233893 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.233979 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.234202 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.234288 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.234519 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.234607 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.234827 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.234914 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.235135 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.235220 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.235440 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.235526 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.235779 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.235875 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.236108 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.236210 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.236428 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.236527 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.236749 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.236837 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.237049 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.237143 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.237349 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.237437 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.237648 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.237735 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.237949 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.238044 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.238259 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.238345 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.238565 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.238678 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.238866 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.238966 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.239162 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.239249 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.239461 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.239546 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.239782 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.239874 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.240083 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.240170 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.240382 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.240481 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.240681 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.240776 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.240981 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.241067 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.241276 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.241362 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.241577 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.241665 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.241876 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.241960 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.242179 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.242301 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.242475 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.242577 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.242772 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.242858 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.243077 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.243216 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.243431 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.243525 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.243765 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.243848 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.244052 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.244154 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.244355 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.244441 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.244654 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.244747 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.244955 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.245056 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.245288 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.245377 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.245601 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.245686 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.245921 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.246065 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.246263 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.246361 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.246544 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.246630 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.246851 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.246939 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.247163 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.247249 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.247478 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.247564 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.247815 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.247906 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.248127 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.248216 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.248439 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.248533 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.248753 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.248909 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.249061 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.249148 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.249368 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.249464 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.249675 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.249762 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.249981 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.250068 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.250289 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.250448 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.250601 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.250689 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.250917 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.251002 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.251217 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.251313 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.251536 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.251623 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.251870 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.251960 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.252189 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.252277 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.252507 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.252594 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.252818 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.252907 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.253127 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.253214 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.253435 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.253523 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.253743 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.253830 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.254050 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.254145 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.254353 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.254438 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.254658 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.254754 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.254966 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.255060 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.255268 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.255361 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.255574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.255727 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.255909 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.255996 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.256219 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.256306 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.256535 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.256630 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.256853 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.256938 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.257160 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.257254 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.257472 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.257559 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.257789 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.257874 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.258114 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.258199 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.258423 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.258509 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.259283 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.259422 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.259668 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.259831 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.260006 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.260160 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.260323 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.260474 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.260637 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.260778 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.260944 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:54:11.261033 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 17:54:11.261192 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 17:54:11.414015 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO dbcounter [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] Registered counter for database nova_api Sep 26 17:54:11.416203 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO dbcounter [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] Registered counter for database nova_api Sep 26 17:54:11.435045 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_db.sqlalchemy.engines [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:54:11.437125 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG oslo_db.sqlalchemy.engines [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:54:11.441694 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG dbcounter [-] [105764] Writer thread running {{(pid=105764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:54:11.443540 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writer thread running {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:54:11.499983 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.context [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd60df5b-c4b3-42ae-8ece-991fe5b02264(cell1) {{(pid=105764) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 17:54:11.502264 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.context [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd60df5b-c4b3-42ae-8ece-991fe5b02264(cell1) {{(pid=105763) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 17:54:11.503770 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:54:11.504239 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:54:11.505797 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:54:11.506184 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:54:11.506512 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:54:11.506654 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:54:11.506951 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:54:11.508237 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:54:11.509594 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 17:54:11.509850 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:54:11.509997 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 17:54:11.511734 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO dbcounter [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] Registered counter for database nova_cell0 Sep 26 17:54:11.512015 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 17:54:11.514251 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO dbcounter [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] Registered counter for database nova_cell0 Sep 26 17:54:11.516039 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO dbcounter [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] Registered counter for database nova_cell1 Sep 26 17:54:11.518209 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO dbcounter [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] Registered counter for database nova_cell1 Sep 26 17:54:11.523304 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_db.sqlalchemy.engines [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:54:11.525633 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_db.sqlalchemy.engines [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:54:11.527972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG oslo_db.sqlalchemy.engines [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:54:11.530411 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG oslo_db.sqlalchemy.engines [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:54:11.531434 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG dbcounter [-] [105764] Writer thread running {{(pid=105764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:54:11.532893 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG dbcounter [-] [105764] Writer thread running {{(pid=105764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:54:11.535832 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writer thread running {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:54:11.538041 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writer thread running {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:54:11.677630 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO dbcounter [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] Registered counter for database nova_cell0 Sep 26 17:54:11.683180 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO dbcounter [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] Registered counter for database nova_cell0 Sep 26 17:54:11.687271 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_db.sqlalchemy.engines [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:54:11.691773 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG oslo_db.sqlalchemy.engines [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:54:11.692120 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG dbcounter [-] [105764] Writer thread running {{(pid=105764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:54:11.697041 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writer thread running {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:54:12.110421 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: WARNING keystonemiddleware.auth_token [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 17:54:12.117714 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: WARNING keystonemiddleware.auth_token [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 17:54:12.137026 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: WARNING keystonemiddleware.auth_token [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 17:54:12.144524 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: WARNING keystonemiddleware.auth_token [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 17:54:12.462752 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: WARNING keystonemiddleware.auth_token [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 17:54:12.468723 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: WARNING keystonemiddleware.auth_token [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 17:54:12.474140 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557ab65999c0 pid: 105764 (default app) Sep 26 17:54:12.476199 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:54:12.477361 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001718 Sep 26 17:54:12.477792 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 788 bytes} [Mon Sep 26 17:54:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:54:12.485103 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: WARNING keystonemiddleware.auth_token [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 17:54:12.491051 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: WARNING keystonemiddleware.auth_token [None req-977a57df-0b7a-4bc8-b824-46437bf6870d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 17:54:12.497134 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557ab65999c0 pid: 105763 (default app) Sep 26 17:55:37.489181 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:37.491084 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 26 17:55:37.497154 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 2/2] 10.222.0.67 () {54 vars in 931 bytes} [Mon Sep 26 17:55:37 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:55:37.504120 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_api:SELECT=3 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:37.506291 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_cell0:SELECT=3 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:37.507100 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_cell1:SELECT=3 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:37.509212 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:38.398586 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-4dea0a76-bf56-4ad3-803d-c4b0ed63d928 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:38.432180 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-4dea0a76-bf56-4ad3-803d-c4b0ed63d928 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.933174 Sep 26 17:55:38.439777 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 1/3] 10.222.0.67 () {60 vars in 1292 bytes} [Mon Sep 26 17:55:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:55:41.060970 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:41.061988 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-24a17564-a15a-4cb4-be19-d2b7580b3516 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 26 17:55:41.063816 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 3/4] 10.222.0.67 () {54 vars in 931 bytes} [Mon Sep 26 17:55:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:55:41.516917 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-7f66ca51-147e-4110-b75b-4f37c3970d0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "vcpus": 1, "id": "c1"}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:55:41.648393 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-7f66ca51-147e-4110-b75b-4f37c3970d0c admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.579744 Sep 26 17:55:41.649014 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 2/5] 10.222.0.67 () {64 vars in 1283 bytes} [Mon Sep 26 17:55:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:55:41.662315 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG dbcounter [-] [105764] Writing DB stats nova_api:SELECT=3 {{(pid=105764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:41.663125 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG dbcounter [-] [105764] Writing DB stats nova_cell1:SELECT=3 {{(pid=105764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:41.664940 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG dbcounter [-] [105764] Writing DB stats nova_cell0:SELECT=3 {{(pid=105764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:41.665705 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG dbcounter [-] [105764] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:41.890576 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-bbaf4b7e-011b-4619-acc3-924c50cc7ba7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:55:42.035338 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-bbaf4b7e-011b-4619-acc3-924c50cc7ba7 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.378069 Sep 26 17:55:42.035984 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 4/6] 10.222.0.67 () {64 vars in 1336 bytes} [Mon Sep 26 17:55:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:55:44.673003 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-7f66ca51-147e-4110-b75b-4f37c3970d0c admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:44.674017 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-7f66ca51-147e-4110-b75b-4f37c3970d0c admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 26 17:55:44.674409 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 3/7] 10.222.0.67 () {54 vars in 931 bytes} [Mon Sep 26 17:55:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:55:45.346712 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-3c8110bc-f5bb-4ebf-bbc0-96d12e84fc3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 5, "ram": 512, "id": "d1", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:55:45.479986 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-3c8110bc-f5bb-4ebf-bbc0-96d12e84fc3f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.798443 Sep 26 17:55:45.480558 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 5/8] 10.222.0.67 () {64 vars in 1283 bytes} [Mon Sep 26 17:55:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:55:45.492792 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-f8c02727-302d-485e-ae18-62f96c6ba9e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:55:45.619713 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-f8c02727-302d-485e-ae18-62f96c6ba9e7 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130744 Sep 26 17:55:45.620370 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 4/9] 10.222.0.67 () {64 vars in 1336 bytes} [Mon Sep 26 17:55:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:55:48.199181 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-3c8110bc-f5bb-4ebf-bbc0-96d12e84fc3f admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:48.200222 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-3c8110bc-f5bb-4ebf-bbc0-96d12e84fc3f admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Sep 26 17:55:48.200624 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 6/10] 10.222.0.67 () {54 vars in 931 bytes} [Mon Sep 26 17:55:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:55:48.623580 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-fd9cd61e-48c7-49a2-9902-c902000cd3a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:55:48.691894 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-fd9cd61e-48c7-49a2-9902-c902000cd3a3 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.484606 Sep 26 17:55:48.692442 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 5/11] 10.222.0.67 () {64 vars in 1283 bytes} [Mon Sep 26 17:55:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:55:48.704696 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-5c37bff4-aaf8-43ec-bccc-89bdb4d6cd19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:55:48.794372 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-5c37bff4-aaf8-43ec-bccc-89bdb4d6cd19 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091512 Sep 26 17:55:48.794372 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 7/12] 10.222.0.67 () {64 vars in 1336 bytes} [Mon Sep 26 17:55:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:55:51.456847 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-fd9cd61e-48c7-49a2-9902-c902000cd3a3 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:51.457868 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-fd9cd61e-48c7-49a2-9902-c902000cd3a3 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 26 17:55:51.458801 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 6/13] 10.222.0.67 () {54 vars in 931 bytes} [Mon Sep 26 17:55:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:55:51.897707 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-4a4575db-1d5d-41d1-9fd8-098b32b38a45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "name": "ds2G", "disk": 10, "vcpus": 2, "id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:55:51.971259 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-4a4575db-1d5d-41d1-9fd8-098b32b38a45 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506081 Sep 26 17:55:51.971844 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 8/14] 10.222.0.67 () {64 vars in 1283 bytes} [Mon Sep 26 17:55:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 17:55:51.984985 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-a75d2a04-ab43-4cbd-b0bd-43f08e1bcea0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:55:52.061023 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-a75d2a04-ab43-4cbd-b0bd-43f08e1bcea0 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079499 Sep 26 17:55:52.065673 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 7/15] 10.222.0.67 () {64 vars in 1336 bytes} [Mon Sep 26 17:55:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:55:54.724128 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-4a4575db-1d5d-41d1-9fd8-098b32b38a45 admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:54.725262 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-4a4575db-1d5d-41d1-9fd8-098b32b38a45 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001686 Sep 26 17:55:54.725701 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 9/16] 10.222.0.67 () {54 vars in 931 bytes} [Mon Sep 26 17:55:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:55:55.183024 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-a5f3e5c2-f99b-4698-ae54-28be3e21dd67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "id": "d4", "vcpus": 4, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:55:55.248387 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-a5f3e5c2-f99b-4698-ae54-28be3e21dd67 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.516185 Sep 26 17:55:55.249040 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 8/17] 10.222.0.67 () {64 vars in 1283 bytes} [Mon Sep 26 17:55:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:55:55.265407 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-7e8d9b21-2825-4cf7-9172-2fd064508687 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:55:55.348144 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-7e8d9b21-2825-4cf7-9172-2fd064508687 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087830 Sep 26 17:55:55.348956 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 10/18] 10.222.0.67 () {64 vars in 1336 bytes} [Mon Sep 26 17:55:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:55:58.760677 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-a5f3e5c2-f99b-4698-ae54-28be3e21dd67 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:58.762015 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-a5f3e5c2-f99b-4698-ae54-28be3e21dd67 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001920 Sep 26 17:55:58.762528 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 9/19] 10.222.0.67 () {54 vars in 931 bytes} [Mon Sep 26 17:55:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:55:59.198978 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-c4179ae6-c7c6-4d76-b118-8ce50a248a25 admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:55:59.225452 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-c4179ae6-c7c6-4d76-b118-8ce50a248a25 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.454585 Sep 26 17:55:59.226064 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 11/20] 10.222.0.67 () {60 vars in 1292 bytes} [Mon Sep 26 17:55:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:56:01.946721 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-a5f3e5c2-f99b-4698-ae54-28be3e21dd67 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:01.947839 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-a5f3e5c2-f99b-4698-ae54-28be3e21dd67 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Sep 26 17:56:01.948262 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 10/21] 10.222.0.67 () {54 vars in 931 bytes} [Mon Sep 26 17:56:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:56:02.373405 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-941fd24d-7b8b-4971-a474-fde413bc8ec0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny"}} {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:56:02.449620 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-941fd24d-7b8b-4971-a474-fde413bc8ec0 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.495063 Sep 26 17:56:02.450096 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 12/22] 10.222.0.67 () {64 vars in 1283 bytes} [Mon Sep 26 17:56:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:56:02.462208 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-95d24519-f3aa-43cc-946b-00ee04f500d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:56:02.556217 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-95d24519-f3aa-43cc-946b-00ee04f500d3 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097608 Sep 26 17:56:02.556807 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 11/23] 10.222.0.67 () {64 vars in 1333 bytes} [Mon Sep 26 17:56:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:56:05.154465 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-941fd24d-7b8b-4971-a474-fde413bc8ec0 admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:05.155480 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-941fd24d-7b8b-4971-a474-fde413bc8ec0 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 26 17:56:05.156205 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 931 bytes} [Mon Sep 26 17:56:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:56:05.548039 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-37701684-96c3-4da1-be45-54a3c9a76d7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "ram": 2048, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:56:05.621738 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-37701684-96c3-4da1-be45-54a3c9a76d7e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458943 Sep 26 17:56:05.622382 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 12/25] 10.222.0.67 () {64 vars in 1283 bytes} [Mon Sep 26 17:56:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:56:05.634934 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-b1377570-2eee-4f72-ba26-3d8e9726ae20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:56:05.724446 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-b1377570-2eee-4f72-ba26-3d8e9726ae20 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093058 Sep 26 17:56:05.725025 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 14/26] 10.222.0.67 () {64 vars in 1333 bytes} [Mon Sep 26 17:56:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:56:08.442181 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-37701684-96c3-4da1-be45-54a3c9a76d7e admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:08.443428 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-37701684-96c3-4da1-be45-54a3c9a76d7e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001728 Sep 26 17:56:08.443879 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 13/27] 10.222.0.67 () {54 vars in 931 bytes} [Mon Sep 26 17:56:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:56:08.883683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-dbec9e6d-4656-40d6-861c-0fbc7216454e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:56:08.970921 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-dbec9e6d-4656-40d6-861c-0fbc7216454e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.520313 Sep 26 17:56:08.971476 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 15/28] 10.222.0.67 () {64 vars in 1283 bytes} [Mon Sep 26 17:56:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:56:08.991914 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-9c4cdcb6-300c-4113-bdba-2f4102735f20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:56:09.005818 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:09.110244 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-9c4cdcb6-300c-4113-bdba-2f4102735f20 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129997 Sep 26 17:56:09.111180 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 14/29] 10.222.0.67 () {64 vars in 1333 bytes} [Mon Sep 26 17:56:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:56:11.768821 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-dbec9e6d-4656-40d6-861c-0fbc7216454e admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:11.769827 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-dbec9e6d-4656-40d6-861c-0fbc7216454e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 26 17:56:11.770457 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 16/30] 10.222.0.67 () {54 vars in 931 bytes} [Mon Sep 26 17:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:56:12.281283 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-96b14ef2-f19d-4c05-93c4-dbb5175eaaac admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:56:12.354661 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-96b14ef2-f19d-4c05-93c4-dbb5175eaaac admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.577687 Sep 26 17:56:12.355198 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 15/31] 10.222.0.67 () {64 vars in 1283 bytes} [Mon Sep 26 17:56:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:56:12.367983 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-0ba1763c-46c7-4c20-89f3-0149add5151a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:56:12.489997 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-0ba1763c-46c7-4c20-89f3-0149add5151a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125353 Sep 26 17:56:12.490874 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 17/32] 10.222.0.67 () {64 vars in 1333 bytes} [Mon Sep 26 17:56:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:56:15.181441 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-96b14ef2-f19d-4c05-93c4-dbb5175eaaac admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:15.182454 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-96b14ef2-f19d-4c05-93c4-dbb5175eaaac admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 26 17:56:15.182992 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 16/33] 10.222.0.67 () {54 vars in 931 bytes} [Mon Sep 26 17:56:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 17:56:15.629758 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-6d4679a8-2630-4da5-8801-94854fb12498 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "5"}} {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:56:15.644257 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG dbcounter [-] [105764] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:15.715151 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-6d4679a8-2630-4da5-8801-94854fb12498 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.523844 Sep 26 17:56:15.715927 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 18/34] 10.222.0.67 () {64 vars in 1283 bytes} [Mon Sep 26 17:56:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:56:15.728160 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-aed748c6-4266-4a08-9c7b-e6ba1023c932 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:56:15.808747 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-aed748c6-4266-4a08-9c7b-e6ba1023c932 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084163 Sep 26 17:56:15.809438 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 17/35] 10.222.0.67 () {64 vars in 1333 bytes} [Mon Sep 26 17:56:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:56:32.696727 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-6d4679a8-2630-4da5-8801-94854fb12498 admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:32.697731 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-6d4679a8-2630-4da5-8801-94854fb12498 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 26 17:56:32.698124 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 19/36] 10.222.0.67 () {54 vars in 931 bytes} [Mon Sep 26 17:56:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:56:32.708671 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:33.106569 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-72fbb11d-38fa-4342-96b5-3e999b7565aa admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:33.124878 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-72fbb11d-38fa-4342-96b5-3e999b7565aa admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.420687 Sep 26 17:56:33.126464 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 18/37] 10.222.0.67 () {60 vars in 1292 bytes} [Mon Sep 26 17:56:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:56:34.443137 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-6d4679a8-2630-4da5-8801-94854fb12498 admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:34.444182 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-6d4679a8-2630-4da5-8801-94854fb12498 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 26 17:56:34.444572 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 20/38] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Sep 26 17:56:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:56:34.968393 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-34bbb977-5d38-40be-abd1-65ef0a955a7a admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:34.973692 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.wsgi [None req-34bbb977-5d38-40be-abd1-65ef0a955a7a admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-34bbb977-5d38-40be-abd1-65ef0a955a7a admin admin] Request method failure captured: Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Accept: application/json Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Accept-Encoding: gzip, deflate Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Connection: keep-alive Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Content-Length: 0 Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Host: 10.222.0.67 Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Openstack-Api-Version: compute 2.92 Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Openstack-System-Scope: None Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: User-Agent: python-novaclient Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Auth-Token: gAAAAABjMefSM1BY9KQD5PQdfck1HVSX3SZiRra58HCCmcK197DKfoXT2ufELW6r7U7j4C2MyMT_w68Cg6bB5j9dRMfTD4UZ5H3ciFdiwhFGAJAizP7eJU53GGTEBZNZMesf9s7Oe3c8GUSEaRBQOtJ7pHWxrdmWASTN6pNe5Nww7bgYCbZxS0Q Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Domain-Id: None Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Domain-Name: None Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Identity-Status: Confirmed Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Is-Admin-Project: True Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Project-Domain-Id: default Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Project-Domain-Name: Default Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Project-Id: 1537d57f83734659b1130d2661d44ac2 Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Project-Name: admin Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Role: admin,reader,member Sep 26 17:56:34.977011 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Roles: admin,reader,member Sep 26 17:56:34.978683 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1537d57f83734659b1130d2661d44ac2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 17:56:34.978683 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Tenant: admin Sep 26 17:56:34.978683 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Tenant-Id: 1537d57f83734659b1130d2661d44ac2 Sep 26 17:56:34.978683 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Tenant-Name: admin Sep 26 17:56:34.978683 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-User: admin Sep 26 17:56:34.978683 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-User-Domain-Id: default Sep 26 17:56:34.978683 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-User-Domain-Name: Default Sep 26 17:56:34.978683 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-User-Id: e71ead94768141dc94d90c67625c3ac2 Sep 26 17:56:34.978683 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-User-Name: admin Sep 26 17:56:34.978683 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: method: > Sep 26 17:56:34.978683 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: exception: Flavor 42 could not be found. Sep 26 17:56:34.978683 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: action_args: {'id': '42'} Sep 26 17:56:34.978683 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:56:34.978683 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:56:34.979805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Sep 26 17:56:34.981071 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-34bbb977-5d38-40be-abd1-65ef0a955a7a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:56:34.982160 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-34bbb977-5d38-40be-abd1-65ef0a955a7a admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.397897 Sep 26 17:56:34.982160 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 19/39] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Sep 26 17:56:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:34.989131 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-c252554c-64c5-4323-9be2-35b529ccf9b4 admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:35.012351 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-c252554c-64c5-4323-9be2-35b529ccf9b4 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027608 Sep 26 17:56:35.013173 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 21/40] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Sep 26 17:56:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:56:35.024146 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-0b2653d5-e251-4dec-aeea-a5bc51a01b67 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:35.046013 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-0b2653d5-e251-4dec-aeea-a5bc51a01b67 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026715 Sep 26 17:56:35.046560 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 20/41] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Sep 26 17:56:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:56:35.056659 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-7c0cb7b2-738a-4d8d-a165-011678856b69 admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:35.062477 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.wsgi [None req-7c0cb7b2-738a-4d8d-a165-011678856b69 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-7c0cb7b2-738a-4d8d-a165-011678856b69 admin admin] Request method failure captured: Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Accept: application/json Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Accept-Encoding: gzip, deflate Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Connection: keep-alive Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Content-Length: 0 Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Host: 10.222.0.67 Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Openstack-Api-Version: compute 2.92 Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Openstack-System-Scope: None Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: User-Agent: python-novaclient Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Auth-Token: gAAAAABjMefSM1BY9KQD5PQdfck1HVSX3SZiRra58HCCmcK197DKfoXT2ufELW6r7U7j4C2MyMT_w68Cg6bB5j9dRMfTD4UZ5H3ciFdiwhFGAJAizP7eJU53GGTEBZNZMesf9s7Oe3c8GUSEaRBQOtJ7pHWxrdmWASTN6pNe5Nww7bgYCbZxS0Q Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Domain-Id: None Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Domain-Name: None Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Identity-Status: Confirmed Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Is-Admin-Project: True Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Project-Domain-Id: default Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Project-Domain-Name: Default Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Project-Id: 1537d57f83734659b1130d2661d44ac2 Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Project-Name: admin Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Role: admin,reader,member Sep 26 17:56:35.065883 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Roles: admin,reader,member Sep 26 17:56:35.067612 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1537d57f83734659b1130d2661d44ac2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 17:56:35.067612 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Tenant: admin Sep 26 17:56:35.067612 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Tenant-Id: 1537d57f83734659b1130d2661d44ac2 Sep 26 17:56:35.067612 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Tenant-Name: admin Sep 26 17:56:35.067612 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-User: admin Sep 26 17:56:35.067612 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-User-Domain-Id: default Sep 26 17:56:35.067612 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-User-Domain-Name: Default Sep 26 17:56:35.067612 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-User-Id: e71ead94768141dc94d90c67625c3ac2 Sep 26 17:56:35.067612 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-User-Name: admin Sep 26 17:56:35.067612 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: method: > Sep 26 17:56:35.067612 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: exception: Flavor 42 could not be found. Sep 26 17:56:35.067612 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: action_args: {'id': '42'} Sep 26 17:56:35.067612 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:56:35.067612 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:56:35.068484 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Sep 26 17:56:35.069584 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-7c0cb7b2-738a-4d8d-a165-011678856b69 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:56:35.070880 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-7c0cb7b2-738a-4d8d-a165-011678856b69 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014585 Sep 26 17:56:35.070880 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 22/42] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Sep 26 17:56:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 26 17:56:36.296499 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-0b2653d5-e251-4dec-aeea-a5bc51a01b67 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:36.297524 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-0b2653d5-e251-4dec-aeea-a5bc51a01b67 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Sep 26 17:56:36.297921 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 21/43] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Sep 26 17:56:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:56:36.829492 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-448430a0-6676-41ef-add6-ad106ea717c2 admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:36.835163 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.wsgi [None req-448430a0-6676-41ef-add6-ad106ea717c2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-448430a0-6676-41ef-add6-ad106ea717c2 admin admin] Request method failure captured: Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Accept: application/json Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Accept-Encoding: gzip, deflate Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Connection: keep-alive Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Content-Length: 0 Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Host: 10.222.0.67 Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Openstack-Api-Version: compute 2.92 Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Openstack-System-Scope: None Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: User-Agent: python-novaclient Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Auth-Token: gAAAAABjMefUogdOWVfs__HOoc1AMnOAPoUXQ8qN0KDa6BiKwIOmBxKFyR_3o2EQrtEET9BJSbySfOF1Y-RZOODek2qyzBVKt1dGnOZS2FwPCfwUSuarLLDJnmEjVv7Aw757gMFjMUcsmS7kY-PdRe7aO3pvJRj5bPwwpsyE7pjgRfkfX1B2Hoo Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Domain-Id: None Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Domain-Name: None Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Identity-Status: Confirmed Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Is-Admin-Project: True Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Project-Domain-Id: default Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Project-Domain-Name: Default Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Project-Id: 1537d57f83734659b1130d2661d44ac2 Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Project-Name: admin Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Role: admin,reader,member Sep 26 17:56:36.836683 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Roles: admin,reader,member Sep 26 17:56:36.838207 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1537d57f83734659b1130d2661d44ac2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 17:56:36.838207 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Tenant: admin Sep 26 17:56:36.838207 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Tenant-Id: 1537d57f83734659b1130d2661d44ac2 Sep 26 17:56:36.838207 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Tenant-Name: admin Sep 26 17:56:36.838207 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-User: admin Sep 26 17:56:36.838207 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-User-Domain-Id: default Sep 26 17:56:36.838207 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-User-Domain-Name: Default Sep 26 17:56:36.838207 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-User-Id: e71ead94768141dc94d90c67625c3ac2 Sep 26 17:56:36.838207 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-User-Name: admin Sep 26 17:56:36.838207 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: method: > Sep 26 17:56:36.838207 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: exception: Flavor 84 could not be found. Sep 26 17:56:36.838207 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: action_args: {'id': '84'} Sep 26 17:56:36.838207 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:56:36.838207 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:56:36.839153 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Sep 26 17:56:36.840574 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-448430a0-6676-41ef-add6-ad106ea717c2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:56:36.841819 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-448430a0-6676-41ef-add6-ad106ea717c2 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.402092 Sep 26 17:56:36.841819 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 23/44] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Sep 26 17:56:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:36.848391 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-9d1a74da-5381-4451-ad06-ade168c34d8c admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:36.863816 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-9d1a74da-5381-4451-ad06-ade168c34d8c admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018723 Sep 26 17:56:36.864379 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 22/45] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Sep 26 17:56:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:56:36.873732 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-088ee85f-de69-4a61-b743-58822794a07e admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:36.889254 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-088ee85f-de69-4a61-b743-58822794a07e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019022 Sep 26 17:56:36.889772 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 24/46] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Sep 26 17:56:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 17:56:36.899489 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-7901a341-8b25-4551-bf7c-fb1c28b3ae20 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:36.904484 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.wsgi [None req-7901a341-8b25-4551-bf7c-fb1c28b3ae20 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-7901a341-8b25-4551-bf7c-fb1c28b3ae20 admin admin] Request method failure captured: Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Accept: application/json Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Accept-Encoding: gzip, deflate Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Connection: keep-alive Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Content-Length: 0 Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Host: 10.222.0.67 Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Openstack-Api-Version: compute 2.92 Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Openstack-System-Scope: None Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: User-Agent: python-novaclient Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Auth-Token: gAAAAABjMefUogdOWVfs__HOoc1AMnOAPoUXQ8qN0KDa6BiKwIOmBxKFyR_3o2EQrtEET9BJSbySfOF1Y-RZOODek2qyzBVKt1dGnOZS2FwPCfwUSuarLLDJnmEjVv7Aw757gMFjMUcsmS7kY-PdRe7aO3pvJRj5bPwwpsyE7pjgRfkfX1B2Hoo Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Domain-Id: None Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Domain-Name: None Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Identity-Status: Confirmed Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Is-Admin-Project: True Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Project-Domain-Id: default Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Project-Domain-Name: Default Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Project-Id: 1537d57f83734659b1130d2661d44ac2 Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Project-Name: admin Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Role: admin,reader,member Sep 26 17:56:36.905972 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Roles: admin,reader,member Sep 26 17:56:36.907427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1537d57f83734659b1130d2661d44ac2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 17:56:36.907427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Tenant: admin Sep 26 17:56:36.907427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Tenant-Id: 1537d57f83734659b1130d2661d44ac2 Sep 26 17:56:36.907427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Tenant-Name: admin Sep 26 17:56:36.907427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-User: admin Sep 26 17:56:36.907427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-User-Domain-Id: default Sep 26 17:56:36.907427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-User-Domain-Name: Default Sep 26 17:56:36.907427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-User-Id: e71ead94768141dc94d90c67625c3ac2 Sep 26 17:56:36.907427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-User-Name: admin Sep 26 17:56:36.907427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: method: > Sep 26 17:56:36.907427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: exception: Flavor 84 could not be found. Sep 26 17:56:36.907427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: action_args: {'id': '84'} Sep 26 17:56:36.907427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:56:36.907427 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:56:36.908466 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Sep 26 17:56:36.910556 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-7901a341-8b25-4551-bf7c-fb1c28b3ae20 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:56:36.911812 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-7901a341-8b25-4551-bf7c-fb1c28b3ae20 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011317 Sep 26 17:56:36.911812 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 23/47] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Sep 26 17:56:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:38.140413 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-088ee85f-de69-4a61-b743-58822794a07e admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:38.141421 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-088ee85f-de69-4a61-b743-58822794a07e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 26 17:56:38.141821 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 25/48] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Sep 26 17:56:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:56:38.677370 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-4edd9fe7-5a0f-40e5-be89-e29e09cae64b admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:38.683082 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.wsgi [None req-4edd9fe7-5a0f-40e5-be89-e29e09cae64b admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-4edd9fe7-5a0f-40e5-be89-e29e09cae64b admin admin] Request method failure captured: Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Accept: application/json Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Accept-Encoding: gzip, deflate Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Connection: keep-alive Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Content-Length: 0 Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Host: 10.222.0.67 Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Openstack-Api-Version: compute 2.92 Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Openstack-System-Scope: None Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: User-Agent: python-novaclient Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Auth-Token: gAAAAABjMefW1pmocS05eiBdaH7zMORXsjUZ52x-2wOK7L8jdzxKkPRel87TiHdPPYzE_2dXmz7VWqkx7jdXWmxZCFRcE3WubxZ_XUPy0PFPv2iLDaSX-9BTnXSO7_JJzIt_vztLByF_m3fVNulWxDjHz4LPqkbUXNGjXxIQzv28SgjSeyQey3Q Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Domain-Id: None Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Domain-Name: None Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Identity-Status: Confirmed Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Is-Admin-Project: True Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Project-Domain-Id: default Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Project-Domain-Name: Default Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Project-Id: 1537d57f83734659b1130d2661d44ac2 Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Project-Name: admin Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Role: admin,reader,member Sep 26 17:56:38.684598 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Roles: admin,reader,member Sep 26 17:56:38.686195 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1537d57f83734659b1130d2661d44ac2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 17:56:38.686195 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Tenant: admin Sep 26 17:56:38.686195 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Tenant-Id: 1537d57f83734659b1130d2661d44ac2 Sep 26 17:56:38.686195 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-Tenant-Name: admin Sep 26 17:56:38.686195 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-User: admin Sep 26 17:56:38.686195 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-User-Domain-Id: default Sep 26 17:56:38.686195 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-User-Domain-Name: Default Sep 26 17:56:38.686195 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-User-Id: e71ead94768141dc94d90c67625c3ac2 Sep 26 17:56:38.686195 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: X-User-Name: admin Sep 26 17:56:38.686195 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: method: > Sep 26 17:56:38.686195 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: exception: Flavor 451 could not be found. Sep 26 17:56:38.686195 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: action_args: {'id': '451'} Sep 26 17:56:38.686195 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:56:38.686195 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:56:38.687061 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Sep 26 17:56:38.688470 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-4edd9fe7-5a0f-40e5-be89-e29e09cae64b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:56:38.689746 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-4edd9fe7-5a0f-40e5-be89-e29e09cae64b admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.400481 Sep 26 17:56:38.689746 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 24/49] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Sep 26 17:56:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:38.696246 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-a5f786c6-0329-4281-8216-0a7ba338ee77 admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:38.710967 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-a5f786c6-0329-4281-8216-0a7ba338ee77 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018219 Sep 26 17:56:38.711487 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 26/50] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Sep 26 17:56:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:56:38.720610 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-c80bd1e6-b8f8-4fad-a528-5fe0f07ead9f admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:38.735141 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-c80bd1e6-b8f8-4fad-a528-5fe0f07ead9f admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.017977 Sep 26 17:56:38.735674 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 25/51] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Sep 26 17:56:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 17:56:38.745278 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-b431bfe9-bcf5-447b-bc77-c7f718b508e7 admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:38.750117 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.wsgi [None req-b431bfe9-bcf5-447b-bc77-c7f718b508e7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-b431bfe9-bcf5-447b-bc77-c7f718b508e7 admin admin] Request method failure captured: Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Accept: application/json Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Accept-Encoding: gzip, deflate Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Connection: keep-alive Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Content-Length: 0 Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Host: 10.222.0.67 Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Openstack-Api-Version: compute 2.92 Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Openstack-System-Scope: None Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: User-Agent: python-novaclient Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Auth-Token: gAAAAABjMefW1pmocS05eiBdaH7zMORXsjUZ52x-2wOK7L8jdzxKkPRel87TiHdPPYzE_2dXmz7VWqkx7jdXWmxZCFRcE3WubxZ_XUPy0PFPv2iLDaSX-9BTnXSO7_JJzIt_vztLByF_m3fVNulWxDjHz4LPqkbUXNGjXxIQzv28SgjSeyQey3Q Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Domain-Id: None Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Domain-Name: None Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Identity-Status: Confirmed Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Is-Admin-Project: True Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Project-Domain-Id: default Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Project-Domain-Name: Default Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Project-Id: 1537d57f83734659b1130d2661d44ac2 Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Project-Name: admin Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Role: admin,reader,member Sep 26 17:56:38.751599 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Roles: admin,reader,member Sep 26 17:56:38.753776 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1537d57f83734659b1130d2661d44ac2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1537d57f83734659b1130d2661d44ac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 17:56:38.753776 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Tenant: admin Sep 26 17:56:38.753776 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Tenant-Id: 1537d57f83734659b1130d2661d44ac2 Sep 26 17:56:38.753776 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-Tenant-Name: admin Sep 26 17:56:38.753776 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-User: admin Sep 26 17:56:38.753776 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-User-Domain-Id: default Sep 26 17:56:38.753776 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-User-Domain-Name: Default Sep 26 17:56:38.753776 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-User-Id: e71ead94768141dc94d90c67625c3ac2 Sep 26 17:56:38.753776 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: X-User-Name: admin Sep 26 17:56:38.753776 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: method: > Sep 26 17:56:38.753776 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: exception: Flavor 451 could not be found. Sep 26 17:56:38.753776 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: action_args: {'id': '451'} Sep 26 17:56:38.753776 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 17:56:38.753776 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:56:38.754812 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: ERROR nova.api.openstack.wsgi Sep 26 17:56:38.756132 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-b431bfe9-bcf5-447b-bc77-c7f718b508e7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 17:56:38.757408 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-b431bfe9-bcf5-447b-bc77-c7f718b508e7 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011112 Sep 26 17:56:38.757408 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 27/52] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Sep 26 17:56:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 26 17:56:39.974218 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-c80bd1e6-b8f8-4fad-a528-5fe0f07ead9f admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:39.975222 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-c80bd1e6-b8f8-4fad-a528-5fe0f07ead9f admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Sep 26 17:56:39.975617 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 26/53] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Sep 26 17:56:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:56:40.515243 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-153be50c-88d3-41e5-8670-bb86192de580 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:56:40.590820 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-153be50c-88d3-41e5-8670-bb86192de580 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.460278 Sep 26 17:56:40.591372 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 28/54] 10.222.0.67 () {64 vars in 1235 bytes} [Mon Sep 26 17:56:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:56:41.829498 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-c80bd1e6-b8f8-4fad-a528-5fe0f07ead9f admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:41.830508 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-c80bd1e6-b8f8-4fad-a528-5fe0f07ead9f admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 26 17:56:41.830913 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 27/55] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Sep 26 17:56:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:56:42.376198 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-b108adbb-8dd2-430c-98e0-fa82006b949f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:56:42.438075 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-b108adbb-8dd2-430c-98e0-fa82006b949f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.465014 Sep 26 17:56:42.438630 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 29/56] 10.222.0.67 () {64 vars in 1235 bytes} [Mon Sep 26 17:56:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 17:56:43.669724 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-c80bd1e6-b8f8-4fad-a528-5fe0f07ead9f admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:43.670841 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-c80bd1e6-b8f8-4fad-a528-5fe0f07ead9f admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Sep 26 17:56:43.671241 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 28/57] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Sep 26 17:56:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:56:44.205603 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-896f84c0-e307-401f-86c1-0aae59651228 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:56:44.273933 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-896f84c0-e307-401f-86c1-0aae59651228 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.464081 Sep 26 17:56:44.274476 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 30/58] 10.222.0.67 () {64 vars in 1235 bytes} [Mon Sep 26 17:56:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:56:45.494750 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-c80bd1e6-b8f8-4fad-a528-5fe0f07ead9f admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:45.495795 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-c80bd1e6-b8f8-4fad-a528-5fe0f07ead9f admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 26 17:56:45.496196 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 29/59] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Sep 26 17:56:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:56:46.022842 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-d947cd81-771c-4161-b43e-4d48afdcdec4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 17:56:46.110669 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-d947cd81-771c-4161-b43e-4d48afdcdec4 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.476515 Sep 26 17:56:46.111257 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 31/60] 10.222.0.67 () {64 vars in 1235 bytes} [Mon Sep 26 17:56:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 17:56:47.357818 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-c80bd1e6-b8f8-4fad-a528-5fe0f07ead9f admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:47.358816 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-c80bd1e6-b8f8-4fad-a528-5fe0f07ead9f admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 26 17:56:47.359230 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 30/61] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Sep 26 17:56:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:56:47.880410 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-fd076f23-40fb-436e-a529-4456e9f19d68 admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:56:47.900560 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-fd076f23-40fb-436e-a529-4456e9f19d68 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.404378 Sep 26 17:56:47.901088 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 32/62] 10.222.0.67 () {60 vars in 1202 bytes} [Mon Sep 26 17:56:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:57:45.605024 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-c80bd1e6-b8f8-4fad-a528-5fe0f07ead9f admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:45.605947 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-c80bd1e6-b8f8-4fad-a528-5fe0f07ead9f admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Sep 26 17:57:45.606338 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 31/63] 10.222.0.67 () {54 vars in 931 bytes} [Mon Sep 26 17:57:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 17:57:45.617669 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG dbcounter [-] [105764] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:45.997923 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-3fd32e9f-b526-4642-a574-29b1cf23d300 admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:46.020965 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-3fd32e9f-b526-4642-a574-29b1cf23d300 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407792 Sep 26 17:57:46.021510 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 33/64] 10.222.0.67 () {60 vars in 1292 bytes} [Mon Sep 26 17:57:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 17:57:46.043816 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_api:SELECT=14 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:46.047541 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-872e75d1-1d45-411f-a4d5-fc55b2c053a3 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:46.054941 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-872e75d1-1d45-411f-a4d5-fc55b2c053a3 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012600 Sep 26 17:57:46.055463 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 32/65] 10.222.0.67 () {60 vars in 1283 bytes} [Mon Sep 26 17:57:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:46.067075 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-1692e655-5168-4a10-9d01-e16d5780385b admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:46.074225 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-1692e655-5168-4a10-9d01-e16d5780385b admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010752 Sep 26 17:57:46.074738 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 34/66] 10.222.0.67 () {60 vars in 1286 bytes} [Mon Sep 26 17:57:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 17:57:46.087190 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-bb37b409-a088-484b-8e5c-cd640c848868 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:46.097321 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-bb37b409-a088-484b-8e5c-cd640c848868 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013952 Sep 26 17:57:46.097839 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 33/67] 10.222.0.67 () {60 vars in 1286 bytes} [Mon Sep 26 17:57:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 17:57:46.108973 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-31bfd172-18d3-4bd1-aa07-7a853654cb85 admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 17:57:46.116236 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-31bfd172-18d3-4bd1-aa07-7a853654cb85 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010738 Sep 26 17:57:46.116743 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 35/68] 10.222.0.67 () {60 vars in 1283 bytes} [Mon Sep 26 17:57:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:01:05.476812 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-bb37b409-a088-484b-8e5c-cd640c848868 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:05.477810 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-bb37b409-a088-484b-8e5c-cd640c848868 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 26 18:01:05.478203 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 34/69] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Sep 26 18:01:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:01:05.619667 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG dbcounter [-] [105764] Writing DB stats nova_api:SELECT=6 {{(pid=105764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:05.788716 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-b7e269de-9950-43d1-bb58-389b09dfe297 admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:05.793591 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-b7e269de-9950-43d1-bb58-389b09dfe297 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:05.794061 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-b7e269de-9950-43d1-bb58-389b09dfe297 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:05.794488 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-b7e269de-9950-43d1-bb58-389b09dfe297 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:05.795809 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-b7e269de-9950-43d1-bb58-389b09dfe297 admin admin] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:05.796249 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-b7e269de-9950-43d1-bb58-389b09dfe297 admin admin] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:05.796729 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-b7e269de-9950-43d1-bb58-389b09dfe297 admin admin] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:05.829808 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-b7e269de-9950-43d1-bb58-389b09dfe297 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.211376 Sep 26 18:01:05.830382 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 36/70] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Sep 26 18:01:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 18:01:07.049746 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-bb37b409-a088-484b-8e5c-cd640c848868 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:07.050784 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-bb37b409-a088-484b-8e5c-cd640c848868 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 26 18:01:07.051185 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 35/71] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Sep 26 18:01:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:01:07.251452 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-c1f749c5-165c-400a-8915-50f1d911e84e admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:07.254849 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-c1f749c5-165c-400a-8915-50f1d911e84e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:07.255328 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-c1f749c5-165c-400a-8915-50f1d911e84e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:07.255777 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-c1f749c5-165c-400a-8915-50f1d911e84e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:07.261550 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-c1f749c5-165c-400a-8915-50f1d911e84e admin admin] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:07.261550 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-c1f749c5-165c-400a-8915-50f1d911e84e admin admin] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:07.261550 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-c1f749c5-165c-400a-8915-50f1d911e84e admin admin] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:07.278399 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-c1f749c5-165c-400a-8915-50f1d911e84e admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.083593 Sep 26 18:01:07.278987 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 37/72] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Sep 26 18:01:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 18:01:18.819359 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-bb37b409-a088-484b-8e5c-cd640c848868 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:18.820402 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-bb37b409-a088-484b-8e5c-cd640c848868 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 26 18:01:18.820794 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 36/73] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Sep 26 18:01:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:01:18.964740 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG dbcounter [-] [105764] Writing DB stats nova_cell0:SELECT=4 {{(pid=105764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:18.966581 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG dbcounter [-] [105764] Writing DB stats nova_cell1:SELECT=4 {{(pid=105764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:18.967254 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG dbcounter [-] [105764] Writing DB stats nova_api:SELECT=8 {{(pid=105764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:19.020470 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-5e2753ad-e946-42e1-88f5-174336dcbe4c admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:19.024209 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-5e2753ad-e946-42e1-88f5-174336dcbe4c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:19.024691 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-5e2753ad-e946-42e1-88f5-174336dcbe4c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:19.025149 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-5e2753ad-e946-42e1-88f5-174336dcbe4c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:19.025864 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-5e2753ad-e946-42e1-88f5-174336dcbe4c admin admin] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:19.026310 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-5e2753ad-e946-42e1-88f5-174336dcbe4c admin admin] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:19.026731 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-5e2753ad-e946-42e1-88f5-174336dcbe4c admin admin] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:19.053158 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-5e2753ad-e946-42e1-88f5-174336dcbe4c admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.092863 Sep 26 18:01:19.053718 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 38/74] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Sep 26 18:01:18 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:01:20.188076 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-bb37b409-a088-484b-8e5c-cd640c848868 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:20.189084 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-bb37b409-a088-484b-8e5c-cd640c848868 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 26 18:01:20.189483 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 37/75] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Sep 26 18:01:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:01:20.395335 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG nova.api.openstack.wsgi [None req-5d099b3a-1d86-4f4e-a250-383a3b0cecd4 admin admin] Calling method '>' {{(pid=105764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:01:20.398751 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-5d099b3a-1d86-4f4e-a250-383a3b0cecd4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:20.399259 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-5d099b3a-1d86-4f4e-a250-383a3b0cecd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:20.399707 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-5d099b3a-1d86-4f4e-a250-383a3b0cecd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:20.400414 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-5d099b3a-1d86-4f4e-a250-383a3b0cecd4 admin admin] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:01:20.400856 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-5d099b3a-1d86-4f4e-a250-383a3b0cecd4 admin admin] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:01:20.401271 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: DEBUG oslo_concurrency.lockutils [None req-5d099b3a-1d86-4f4e-a250-383a3b0cecd4 admin admin] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:01:20.423458 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: INFO nova.api.openstack.requestlog [None req-5d099b3a-1d86-4f4e-a250-383a3b0cecd4 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.088074 Sep 26 18:01:20.424148 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: [pid: 105764|app: 0|req: 39/76] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Sep 26 18:01:20 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:02:23.919246 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: Mon Sep 26 18:02:23 2022 - graceful shutdown triggered... Sep 26 18:02:23.919805 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: Gracefully killing worker 1 (pid: 105763)... Sep 26 18:02:23.920241 dv-cinder-859319-1-iscsi devstack@n-api.service[105764]: Gracefully killing worker 2 (pid: 105764)... Sep 26 18:02:23.921626 dv-cinder-859319-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 26 18:02:24.050449 dv-cinder-859319-1-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_api:SELECT=4 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:24.920404 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: worker 1 buried after 1 seconds Sep 26 18:02:24.920972 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: worker 2 buried after 1 seconds Sep 26 18:02:24.920972 dv-cinder-859319-1-iscsi devstack@n-api.service[105762]: goodbye to uWSGI. Sep 26 18:02:24.922019 dv-cinder-859319-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 26 18:02:24.922563 dv-cinder-859319-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 26 18:02:24.925395 dv-cinder-859319-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 26 18:02:24.935384 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 26 18:02:24.937975 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 18:02:24 2022] *** Sep 26 18:02:24.938132 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 18:02:24.938259 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 18:02:24.938366 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: nodename: dv-cinder-859319-1-iscsi Sep 26 18:02:24.938473 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: machine: x86_64 Sep 26 18:02:24.938581 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: clock source: unix Sep 26 18:02:24.938774 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: pcre jit disabled Sep 26 18:02:24.938884 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: detected number of CPU cores: 4 Sep 26 18:02:24.938991 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: current working directory: / Sep 26 18:02:24.939103 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: detected binary path: /usr/bin/uwsgi-core Sep 26 18:02:24.939217 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: your processes number limit is 47680 Sep 26 18:02:24.939326 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: your memory page size is 4096 bytes Sep 26 18:02:24.939433 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: detected max file descriptor number: 2048 Sep 26 18:02:24.939550 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: lock engine: pthread robust mutexes Sep 26 18:02:24.939855 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: thunder lock: enabled Sep 26 18:02:24.940152 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 26 18:02:24.940352 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 18:02:24.983404 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: Python main interpreter initialized at 0x56421c9cf9c0 Sep 26 18:02:24.983404 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: python threads support enabled Sep 26 18:02:24.983404 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: your server socket listen backlog is limited to 100 connections Sep 26 18:02:24.983404 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: your mercy for graceful operations on workers is 90 seconds Sep 26 18:02:24.984011 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 18:02:24.984011 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: *** Operational MODE: preforking *** Sep 26 18:02:24.984301 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: *** uWSGI is running in multiple interpreter mode *** Sep 26 18:02:24.984301 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: spawned uWSGI master process (pid: 121009) Sep 26 18:02:24.984379 dv-cinder-859319-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 26 18:02:24.985116 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: spawned uWSGI worker 1 (pid: 121028, cores: 1) Sep 26 18:02:24.985288 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: spawned uWSGI worker 2 (pid: 121029, cores: 1) Sep 26 18:02:24.985620 dv-cinder-859319-1-iscsi devstack@n-api.service[121009]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 18:02:25.669509 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 18:02:25.674632 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 18:02:26.882235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 18:02:26.882235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: from cryptography.utils import int_from_bytes Sep 26 18:02:26.882979 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 18:02:26.882979 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: from cryptography.utils import int_from_bytes Sep 26 18:02:26.897500 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 18:02:26.897500 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: from cryptography.utils import int_from_bytes Sep 26 18:02:26.897500 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 18:02:26.897500 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: from cryptography.utils import int_from_bytes Sep 26 18:02:29.347098 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 18:02:29.347803 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 18:02:29.348082 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 18:02:29.348303 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 18:02:29.348561 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 18:02:29.348957 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.349288 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.349729 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.350057 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.350399 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.350706 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.351031 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.351364 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.351796 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.352064 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.352384 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.352885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859319-1-iscsi {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.353218 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.354180 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.354561 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.354891 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.355319 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.355741 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.355999 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.356515 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.358096 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.358419 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.358741 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.359091 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.359417 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.359776 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.360104 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.360415 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.360746 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.361062 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.361479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859319-1-iscsi {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.361815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.362126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.362437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.362862 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.363180 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.363493 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.363843 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.364172 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.364483 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.364812 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.365138 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.365418 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 18:02:29.365865 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.365946 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 18:02:29.366016 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.366084 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.366299 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 18:02:29.366418 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.366600 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 18:02:29.366707 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.366859 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 18:02:29.366960 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.367257 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.367369 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.367565 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.367698 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.367858 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.367955 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.368153 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.368265 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.368477 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.368582 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.368800 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.368912 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.369858 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.369980 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.370054 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.370270 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.370366 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.370644 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.370893 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.371059 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.371158 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.371361 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.371485 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.371688 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.371941 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859319-1-iscsi {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.372047 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.372276 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.372388 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.372594 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.372700 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.372903 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.373058 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.373205 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.373352 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.373499 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.373654 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.373803 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.373956 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.374096 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.374254 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.374411 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.374650 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.374837 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.374989 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.375148 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.375292 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.375478 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.375761 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.375920 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.376066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.376206 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.376343 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.376482 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.376641 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.376794 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.376942 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.377087 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.377244 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.377410 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.377572 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.377715 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.377861 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.378052 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.378212 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859319-1-iscsi {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.378365 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.378503 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.378648 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.378788 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.378932 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.379084 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.379223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.379731 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.379910 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.380062 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.380201 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.380397 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.380551 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.380722 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.380871 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.381018 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.381171 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.381319 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.381478 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.381618 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.381773 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.381913 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.382089 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.382238 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.382384 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.382743 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.382901 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.383049 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.383198 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.383347 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.383486 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.383636 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.384004 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.384175 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.384364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.384508 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.384508 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.384778 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.384961 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.385107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.385107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.385400 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.385539 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.385960 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.385960 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.386286 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.386477 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.386645 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.386794 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.386944 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.387089 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.387242 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.387384 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.387532 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.387789 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.387938 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.388078 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.388793 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.388949 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.389098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.389248 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.389389 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.389565 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.390143 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.390296 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.390528 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.390682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.390823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.391005 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.391164 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.391351 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.391512 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.391709 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.391877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.392083 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.392251 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.392441 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.392616 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.393000 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.393156 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.393338 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.393512 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.393722 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.394480 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.394657 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.394810 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.394960 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.395100 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.395258 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.395405 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.395577 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.395770 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.395915 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.396067 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.396309 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.396480 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.396652 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.396871 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.397064 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.397064 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.397354 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.397354 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.397632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.397771 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.397916 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.398069 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.398209 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.398362 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.398518 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.398659 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.398798 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.398946 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.399093 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.399247 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.399386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.399532 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.399720 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.400891 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.401056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.401205 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.401205 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.401483 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.401634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.401785 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.401933 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.402080 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.402226 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.402373 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.402521 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.402661 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.402807 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.403197 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.403355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.403515 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.403688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.403846 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.403988 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.404126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.404126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.404401 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.404559 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.404705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.404854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.404994 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.405140 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.405279 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.405443 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.405836 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.406004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.406144 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.406292 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.406454 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.406606 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.406746 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.406885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.407023 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.407163 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.407314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.407453 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.407609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.407861 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.408005 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.408005 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.408281 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.408429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.408578 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.408725 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.408872 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.409016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.409157 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.409294 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.409443 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.409591 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.409750 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.409889 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.410027 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.410173 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.410312 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.410458 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.411127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.411292 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.411440 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.411634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.411634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.411976 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.412116 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.412263 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.412263 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.412524 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.412524 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.412807 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.412959 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.413360 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.414062 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.414216 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.414357 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.414568 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.414724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.414864 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.415010 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.415191 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.415361 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.415547 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.415739 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.416396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.416590 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.416779 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.416929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.417078 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.417218 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.417404 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.417584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.417741 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.417889 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 18:02:29.418039 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.418206 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.418354 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.418354 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.418654 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.418815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.418956 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.419095 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.419233 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.419389 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.419529 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.419790 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.419958 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.420106 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.420254 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.420402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.420541 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.420541 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.421396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.421572 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.421725 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.421876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.422040 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.422268 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.422419 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.422586 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.422734 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.422913 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.423112 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.423112 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.423782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.423932 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.424109 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.424273 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.424464 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.424637 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.424797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.424952 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.425099 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.425246 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.425426 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.425580 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.425729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.425896 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.426046 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.426229 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.426388 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.426566 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.426719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.426872 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.427042 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.427193 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.427333 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.427472 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.427630 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.427795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.427935 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.428092 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.428233 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.428391 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.428531 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.428676 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.428676 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.428952 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.428952 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.429234 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.429234 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.429503 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.429655 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.429794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.429932 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.430071 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.430219 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.430365 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.430513 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.430660 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.430800 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.430964 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.432237 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.432416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.432572 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.432725 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.432896 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.433194 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.433341 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.433766 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.433964 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.434119 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.434262 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.434401 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.434548 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.434702 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.434850 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.434988 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.435127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.435272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.435272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.435553 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.435733 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.435880 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.436026 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.436165 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.436310 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.436463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.436619 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.436758 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.436895 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.437042 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.437187 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.437340 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.437535 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.437682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.437857 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.438069 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.438792 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.439030 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.439183 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.439331 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.439479 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.439621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.439892 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.440058 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.440058 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.440347 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.440494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.440642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.440795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.440941 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.441081 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.441244 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.441885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.442029 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.442183 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.442331 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.442471 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.442610 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.442761 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.442900 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.443053 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.443201 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.443340 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.443478 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.443634 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.444044 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.444196 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.444352 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.444509 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.444656 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.444797 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.444954 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.445095 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.445233 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.445379 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.445518 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.445665 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.445813 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.445959 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.446104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.446242 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.446391 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.446546 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.446706 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.446847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.446993 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.447182 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.447339 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.447546 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.447847 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.447999 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.448139 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.448354 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.448509 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.448661 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.448809 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.448968 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.449115 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.449254 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.449399 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.449547 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.449686 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.449824 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.449969 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.450117 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.450255 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.450405 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.450550 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.450696 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.450844 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.450989 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.451128 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.451280 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.451445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.452113 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.452256 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.452406 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.452556 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.452703 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.452850 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.452991 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.453137 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.453288 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.453436 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.453575 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.453713 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.454121 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.454281 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.454438 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.454652 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.454876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.455053 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.455227 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.455376 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.455576 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.455846 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.456015 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.456157 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.456306 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.456306 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.456645 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.456807 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.456946 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.457131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.457300 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.457532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.457532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.457959 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.458137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.458281 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.458453 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.458602 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.458756 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.458896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.458896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.459175 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.459321 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.459462 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.459609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.459775 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.459935 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.460085 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.460224 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.460371 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.460511 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.460649 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.460794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.460940 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.461085 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.461238 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.461392 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.461532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.462183 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.462346 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.462487 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.462644 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.462854 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.463005 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.463144 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.463281 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.463420 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.463574 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.463746 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.463898 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.463898 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.464450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.464613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.464756 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.464895 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.465033 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.465171 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.465317 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.465466 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.465614 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.465754 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.465899 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.466039 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.466185 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.466333 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.466491 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.466644 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.466789 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.466927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.467065 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.467217 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.467367 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.467506 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.467694 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.467844 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.467998 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.468153 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.468327 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.468552 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.468705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.468846 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.468999 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.468999 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.469274 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.469414 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.469561 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.469700 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.469921 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.470063 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.470203 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.470352 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.470491 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.470637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.470785 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.470939 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.470939 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.471220 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.471360 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.471506 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.471677 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.472133 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.472133 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.472611 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.472764 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.472911 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.473059 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.473154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.473240 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.473331 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.473418 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.473502 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.473584 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.473681 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.473777 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.473860 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.473942 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.474024 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.474121 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.474361 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.474469 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.474575 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.474660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.474741 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.474830 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.474902 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.474983 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.475066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.475149 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.475235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.475330 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.475420 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.475511 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.475669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.475777 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.475863 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.475952 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.476087 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.476192 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.476276 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.476358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.476439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.476521 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.476616 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.476707 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.476789 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.476878 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.476967 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.477051 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.477141 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.477230 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.477320 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.477410 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.477498 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.477588 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.477684 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.477768 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.477857 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.477939 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.478027 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.478119 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.478217 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.478217 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.478898 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.478898 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.478898 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.478898 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.478898 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.478898 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.479324 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.479408 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.479408 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.479408 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.479408 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.479408 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.479408 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.479408 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.479408 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.480120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.480212 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.480212 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.480212 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.480212 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.480212 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.480212 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.480212 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.480715 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.480807 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.480807 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.480969 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.481272 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.481428 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.481579 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.482860 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.482991 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.483089 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.483173 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.483256 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.483346 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.483430 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.483430 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.483588 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.483733 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.483733 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.484052 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.484151 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.484453 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.484664 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.484762 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.484977 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.485262 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.485353 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.485614 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.485855 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.485953 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.486223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.486486 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.486579 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.486825 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.487133 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.487446 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.487543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.487782 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.488090 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.488190 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.488397 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.488689 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.488791 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.488999 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.489294 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.489396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.489625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.489933 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.490030 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.490243 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.490532 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.490626 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.490889 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.491142 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.491242 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.491551 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.491765 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.491903 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.492280 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.492411 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.492654 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.492861 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.493007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.493176 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.493453 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.493557 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.493791 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.494095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.494270 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.494612 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.494726 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.495050 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.495213 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.495364 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.495708 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.495827 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.496022 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.496341 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.496446 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.496644 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.496911 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.497010 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.497283 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.497504 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.497595 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.497908 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.498101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.498224 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.498540 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.498683 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.498856 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.499177 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.499299 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.499492 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.499825 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.499941 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.500144 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.500448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.500572 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.500763 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.501041 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.501151 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.501376 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.501631 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.501730 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.501989 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.502415 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.502532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.502648 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.502907 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.503041 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.503215 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.503422 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.503514 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.503848 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.504024 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.504345 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.504674 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.504790 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.505035 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.505134 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.505404 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.505670 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.505771 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.506016 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.506271 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.506406 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.506638 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.506987 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.507103 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.507263 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.507522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.507613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.508011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.508153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.508330 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.508646 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.508736 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.508963 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.509234 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.509439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.509573 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.510363 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.510499 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.511101 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.511275 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.511406 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.511798 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.511907 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.512113 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.512527 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.512651 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.512726 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.513099 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.513204 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.513489 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.513642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.513810 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.514121 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.514211 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.514544 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.514793 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.514906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.515169 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.515298 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.515498 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.515840 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.515949 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.516169 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.516437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.516537 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.516790 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.517013 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.517122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.517419 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.517616 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.517750 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.518066 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.518164 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.518389 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.518688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.518786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.519014 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.519280 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.519378 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.519666 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.519931 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.520024 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.520427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.520530 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.520723 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.520997 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.521102 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.521352 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.521585 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.521675 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.521981 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.522161 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.522293 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.522665 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.522772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.522914 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.523233 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.523344 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.523561 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.523849 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.523943 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.524196 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.524426 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.524526 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.524811 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.525012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.525115 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.525961 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.526247 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.526407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.528897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.528897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.528897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.528897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.528897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.528897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.529730 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.529899 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.530046 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.530188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.530323 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.530323 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.530693 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.530843 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.530843 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.531097 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.531246 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.531246 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.531520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.531678 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.531938 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.532075 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.532257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.532454 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.532952 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.533105 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.533475 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.533475 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.533743 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.533894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.534050 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.534192 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.534192 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.534464 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.534608 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.534741 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.534888 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.535046 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.535349 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.535489 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.535682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.535881 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.536021 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.536286 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.536419 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.536594 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.536848 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.536995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.537195 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.537361 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.537505 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.537814 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.537976 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.538129 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.538328 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.538465 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.538726 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.538859 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.539036 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.539279 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.539423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.539788 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.539931 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.540067 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.540245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.540383 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.540626 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.540794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.540968 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.541276 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.541431 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.541920 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.542227 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.542227 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.542554 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.542725 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.542725 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.543300 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.543765 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.543936 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.543936 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.544197 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.544299 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.544299 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.544619 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.544712 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.545077 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.545195 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.545531 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.545637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.545851 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.546091 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.546195 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.546477 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.546600 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.546795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.547067 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.547167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.547437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.547561 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.547753 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.548043 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.548143 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.548372 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.548559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.548704 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.549012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.549104 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.549344 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.549532 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.549685 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.549992 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.550091 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.550314 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.550502 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.550634 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.550951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.551057 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.551311 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.551450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.551772 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.551949 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.552084 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.552401 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.552500 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.552718 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.552915 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.553042 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.553359 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.553460 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.553698 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.553888 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.553982 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.554357 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.554514 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.554805 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.554906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.555139 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.555317 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.555474 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.555791 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.555898 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.556118 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.556310 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.556457 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.556810 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.557087 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.557186 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.557402 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.557535 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.557736 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.557911 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.558259 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.558350 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.558577 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.558800 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.558912 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.559239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.559328 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.559567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.559794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.559901 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.560218 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.560336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.560588 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.560713 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.560936 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.561161 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.561263 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.561551 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.561662 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.561865 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.562074 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.562175 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.562481 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.562573 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.562792 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.562948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.563104 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.563381 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.563484 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.563881 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.563989 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.564237 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.564329 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.564623 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.564720 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.564947 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.566370 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.566500 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.566588 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.566679 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.566679 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.566845 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.566937 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.567021 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.567021 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.567249 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.567424 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.567570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.567913 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.568050 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.568239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.568493 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.568648 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.568866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.569181 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.569352 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.569515 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.569859 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.569973 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.570168 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.570407 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.570499 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.570778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.570917 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.571113 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.571376 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.571483 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.571742 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.571914 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.572050 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.572900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.573075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.573214 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.573514 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.573618 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.573821 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.574135 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.574494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.574759 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.574884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.575100 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.575207 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.575432 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.575636 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.575799 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.575893 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.576164 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.576257 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.576478 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.576614 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.576787 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.576880 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.577117 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.577265 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.577427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.577596 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.577733 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.577919 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.578056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.578353 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.578455 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.578681 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.578772 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.578995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.579126 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.579313 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.579452 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.579721 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.579811 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.579991 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.580083 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.580313 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.580556 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.580694 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.580892 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.581000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.581214 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.581324 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.581553 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.581655 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.581888 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.581989 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.582208 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.582321 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.582502 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.582607 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.582811 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.582907 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.583143 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.583248 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.583458 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.583550 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.583811 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.583911 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.584098 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.584651 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.584776 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.584858 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.584931 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.585003 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.585092 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.585307 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.585409 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.585623 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.585739 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.585928 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.586037 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.586260 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.586365 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.586548 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.586638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.586860 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.586966 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.587171 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.587262 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.587481 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.587579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.587893 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.588523 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.588729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.588842 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.589051 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.589144 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.589375 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.589469 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.589693 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.589783 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.590011 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.590110 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.590322 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.590446 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.590638 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.590741 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.590952 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.591051 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.591268 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.591367 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.591588 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.591700 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.591946 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.592115 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.592262 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.592353 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.592572 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.592675 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.592900 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.592999 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.593215 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.593305 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.593531 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.593622 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.593845 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.593969 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.594196 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.594305 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.594515 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.594634 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.594845 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.594958 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.595155 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.595263 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.595478 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.595583 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.595816 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.595937 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.596152 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.596285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.596498 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.596611 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.596825 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.596918 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.597145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.597236 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.597453 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.597556 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.597761 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.597858 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.598071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.598171 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.598386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.598486 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.598703 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.598805 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.599014 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.599103 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.599323 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.599424 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.599628 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.599770 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.599964 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.600115 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.600281 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.600419 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.600562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.600664 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.600868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.600967 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.601175 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.601274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.601485 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.601577 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.601791 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.601889 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.602096 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.602188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.602402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.602501 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.602709 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.602800 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.603019 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.603110 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.603324 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.603434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.603728 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.603831 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.604133 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.604283 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.604379 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.604471 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.604714 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.604828 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.605042 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.605134 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.605363 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.605452 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.605687 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.605786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.606012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.606126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.606328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.606417 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.606655 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.606760 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.606955 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.607047 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.607273 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.607363 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.607584 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.607758 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.607992 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.608091 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.608318 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.608410 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.608636 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.608948 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.609045 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.609285 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.609387 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.609600 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.609706 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.609914 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.610004 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.610228 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.610319 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.610540 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.610639 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.610852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.610942 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.611163 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.611265 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.611484 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.611586 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.611833 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.612923 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.613013 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.613098 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.613192 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.613282 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.613282 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.613431 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.613515 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.613596 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.613686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.613768 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.613850 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.613931 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.614071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.614228 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.614385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.614552 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.614771 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.614914 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.615008 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.615227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.615325 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.615555 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.615741 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.615891 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.616023 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.616214 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.616313 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.616535 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.616659 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.616858 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.616976 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.617170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.617259 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.617544 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.617639 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.617872 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.617982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.618185 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.618283 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.618512 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.618623 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.618877 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.618981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.619240 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.619330 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.619564 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.619835 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.619942 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.620187 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.620285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.620523 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.620615 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.620845 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.620945 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.621160 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.621251 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.621469 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.621563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.621714 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 18:02:29.622018 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.622346 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.622689 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.623027 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.623434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.623784 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.624126 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.624454 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.624771 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.625087 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.625407 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.625726 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.626040 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.626372 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.626697 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.627016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.627335 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.627664 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.628216 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.628600 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.629002 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.629342 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.629683 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.630011 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.630325 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.630653 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.630972 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.631283 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.631607 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.631954 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.632269 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.632583 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.632902 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.633220 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.633535 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.633853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.634165 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.634500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.635348 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.635961 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.641873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.641873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.641873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.641873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.641873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.641873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.641873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.641873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.642529 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.642529 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.642529 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.642529 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.642529 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.642529 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.642529 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.642529 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.643121 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.643121 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.643121 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.643121 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.643121 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.643121 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.643121 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.643627 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.643987 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.644329 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.644659 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.645000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.645341 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.645657 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.646005 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.646314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.646645 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.646978 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.647291 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.647607 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.647953 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.648290 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.648608 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.648924 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.649243 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.649561 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.649877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.650194 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.651076 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.651392 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.651732 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.652088 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.652437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.652764 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.653089 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.653413 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.653737 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.654059 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.654377 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.654697 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.655012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.655337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.655697 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.656018 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.656332 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.656768 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.657090 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.657419 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.657745 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.658061 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.658388 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.658721 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.659035 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.659362 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.659698 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.660037 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.660382 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.660717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.661049 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.661361 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.661672 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.661984 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.662298 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.662623 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.662966 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.663285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.663591 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.663948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.664258 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.664569 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.664881 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.665187 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.665501 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.665813 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.666146 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.666466 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.666775 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.667083 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.667452 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.667732 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.668045 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.668357 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.668665 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.668974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.669280 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.669617 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.669958 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.670281 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.670609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.670927 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.671255 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.671569 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.671935 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.672265 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.672588 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.672904 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.673242 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.673557 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.673873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.674191 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.674509 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.674829 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.675145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.675478 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.675836 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.676147 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.676478 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.676812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.677141 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.677468 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.677822 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.678116 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.678434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.678753 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.679071 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.679391 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.679729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.680056 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.680370 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.680688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.681015 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.681332 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.682234 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.682526 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.682841 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.683173 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.683506 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.687889 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.687889 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.687889 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.687889 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.687889 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.688338 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO dbcounter [None req-bc644248-132e-4728-abfd-f71163618806 None None] Registered counter for database nova_api Sep 26 18:02:29.688432 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.688432 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 18:02:29.688432 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 18:02:29.706713 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_db.sqlalchemy.engines [None req-bc644248-132e-4728-abfd-f71163618806 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 18:02:29.713574 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writer thread running {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 18:02:29.748697 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO dbcounter [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] Registered counter for database nova_api Sep 26 18:02:29.769652 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_db.sqlalchemy.engines [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 18:02:29.770441 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.context [None req-bc644248-132e-4728-abfd-f71163618806 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd60df5b-c4b3-42ae-8ece-991fe5b02264(cell1) {{(pid=121028) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 18:02:29.774482 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc644248-132e-4728-abfd-f71163618806 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:29.774954 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc644248-132e-4728-abfd-f71163618806 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:29.776408 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writer thread running {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 18:02:29.777177 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc644248-132e-4728-abfd-f71163618806 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:29.777915 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc644248-132e-4728-abfd-f71163618806 None None] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:29.778360 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc644248-132e-4728-abfd-f71163618806 None None] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:29.780394 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc644248-132e-4728-abfd-f71163618806 None None] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:29.782392 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO dbcounter [None req-bc644248-132e-4728-abfd-f71163618806 None None] Registered counter for database nova_cell0 Sep 26 18:02:29.786429 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO dbcounter [None req-bc644248-132e-4728-abfd-f71163618806 None None] Registered counter for database nova_cell1 Sep 26 18:02:29.794094 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_db.sqlalchemy.engines [None req-bc644248-132e-4728-abfd-f71163618806 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 18:02:29.797716 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_db.sqlalchemy.engines [None req-bc644248-132e-4728-abfd-f71163618806 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 18:02:29.800693 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writer thread running {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 18:02:29.834468 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.context [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd60df5b-c4b3-42ae-8ece-991fe5b02264(cell1) {{(pid=121029) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 18:02:29.838647 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:29.839130 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:29.840764 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:29.841505 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:02:29.841966 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:02:29.843996 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:02:29.846022 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO dbcounter [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] Registered counter for database nova_cell0 Sep 26 18:02:29.850153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO dbcounter [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] Registered counter for database nova_cell1 Sep 26 18:02:29.857632 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_db.sqlalchemy.engines [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 18:02:29.859358 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_db.sqlalchemy.engines [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 18:02:29.865359 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writer thread running {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 18:02:29.866980 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writer thread running {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 18:02:29.942667 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writer thread running {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 18:02:29.953763 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO dbcounter [None req-bc644248-132e-4728-abfd-f71163618806 None None] Registered counter for database nova_cell0 Sep 26 18:02:29.960655 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_db.sqlalchemy.engines [None req-bc644248-132e-4728-abfd-f71163618806 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 18:02:29.965974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writer thread running {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 18:02:30.017233 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO dbcounter [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] Registered counter for database nova_cell0 Sep 26 18:02:30.025168 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_db.sqlalchemy.engines [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 18:02:30.029775 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writer thread running {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 18:02:30.288047 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: WARNING keystonemiddleware.auth_token [None req-bc644248-132e-4728-abfd-f71163618806 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 18:02:30.296163 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: WARNING keystonemiddleware.auth_token [None req-bc644248-132e-4728-abfd-f71163618806 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 18:02:30.358821 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: WARNING keystonemiddleware.auth_token [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 18:02:30.366509 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: WARNING keystonemiddleware.auth_token [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 18:02:30.644738 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: WARNING keystonemiddleware.auth_token [None req-bc644248-132e-4728-abfd-f71163618806 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 18:02:30.652420 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: WARNING keystonemiddleware.auth_token [None req-bc644248-132e-4728-abfd-f71163618806 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 18:02:30.656597 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56421c9cf9c0 pid: 121028 (default app) Sep 26 18:02:30.722104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: WARNING keystonemiddleware.auth_token [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 18:02:30.728293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: WARNING keystonemiddleware.auth_token [None req-47baf1a7-3dd5-4076-a3df-b2c6107a037d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 18:02:30.734239 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56421c9cf9c0 pid: 121029 (default app) Sep 26 18:03:09.344070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=3 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:09.345837 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=3 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:09.346751 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=3 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:09.347537 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=3 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:11.443477 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8a41abea-0f5e-4183-b2a7-5ff24b680b5f tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Action: 'create', calling method: .version_select at 0x7f3a759b1430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1880467610", "metadata": {"Type": "work"}}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8a41abea-0f5e-4183-b2a7-5ff24b680b5f tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Request method failure captured: Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 122 Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMeldCKH8v-ubC3sBOq7-569YQ4YXlfSILRs9KN8lMy3AO4jIc-E4uXmKDCmiR5QNR9fBmoEgjy3EKukKeiG0YXyHcO1xgjzNCXWazrmBkyiUsvht1N1viGLBQhSum9E1EP2LZEcgTYaO63JV5yECTO1CEmki1S7U-Vr9sS6nurrFp7E Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 247ce86198ec46aa9a566403ccefaa28 Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:03:11.460056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:03:11.462396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:03:11.462396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:11.462396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 247ce86198ec46aa9a566403ccefaa28 Sep 26 18:03:11.462396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:11.462396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-VolumesNegativeTest-1540549699-project Sep 26 18:03:11.462396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:03:11.462396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:03:11.462396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 6999c1f707f14c89b1556cdf0f886b53 Sep 26 18:03:11.462396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-VolumesNegativeTest-1540549699-project Sep 26 18:03:11.462396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Sep 26 18:03:11.462396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1880467610", "metadata": {"Type": "work"}}} Sep 26 18:03:11.462396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: Sep 26 18:03:11.462396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1880467610', 'metadata': {'Type': 'work'}}}} Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise error Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi '#$%' Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:03:11.463423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 18:03:11.465127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 18:03:11.466382 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 18:03:11.466382 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.466382 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8a41abea-0f5e-4183-b2a7-5ff24b680b5f tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:03:11.466382 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8a41abea-0f5e-4183-b2a7-5ff24b680b5f tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.139336 Sep 26 18:03:11.479498 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 1/1] 10.222.0.67 () {60 vars in 1156 bytes} [Mon Sep 26 18:03:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 18:03:11.757071 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-6fcebbd6-5aab-4790-80a9-7adf5e041f94 tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Action: 'create', calling method: .version_select at 0x7f3a75a604c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-159211389", "metadata": {"Type": "work"}}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-6fcebbd6-5aab-4790-80a9-7adf5e041f94 tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Request method failure captured: Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 119 Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMeldCKH8v-ubC3sBOq7-569YQ4YXlfSILRs9KN8lMy3AO4jIc-E4uXmKDCmiR5QNR9fBmoEgjy3EKukKeiG0YXyHcO1xgjzNCXWazrmBkyiUsvht1N1viGLBQhSum9E1EP2LZEcgTYaO63JV5yECTO1CEmki1S7U-Vr9sS6nurrFp7E Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: 247ce86198ec46aa9a566403ccefaa28 Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:03:11.764974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:03:11.766416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:03:11.766416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:11.766416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: 247ce86198ec46aa9a566403ccefaa28 Sep 26 18:03:11.766416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:11.766416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-VolumesNegativeTest-1540549699-project Sep 26 18:03:11.766416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:03:11.766416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:03:11.766416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 6999c1f707f14c89b1556cdf0f886b53 Sep 26 18:03:11.766416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-VolumesNegativeTest-1540549699-project Sep 26 18:03:11.766416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Sep 26 18:03:11.766416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-159211389", "metadata": {"Type": "work"}}} Sep 26 18:03:11.766416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: Sep 26 18:03:11.766416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-159211389', 'metadata': {'Type': 'work'}}}} Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise error Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi '0' Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:03:11.767202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 18:03:11.768579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 18:03:11.769642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 18:03:11.769642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.769642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-6fcebbd6-5aab-4790-80a9-7adf5e041f94 tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:03:11.769642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-6fcebbd6-5aab-4790-80a9-7adf5e041f94 tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.295738 Sep 26 18:03:11.769642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 1/2] 10.222.0.67 () {60 vars in 1156 bytes} [Mon Sep 26 18:03:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 299 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 18:03:11.780544 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-0033a0ca-1821-446a-812c-c18674b124e8 tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Action: 'create', calling method: .version_select at 0x7f3a759b1dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-199652066", "metadata": {"Type": "work"}}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-0033a0ca-1821-446a-812c-c18674b124e8 tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Request method failure captured: Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 118 Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMeldCKH8v-ubC3sBOq7-569YQ4YXlfSILRs9KN8lMy3AO4jIc-E4uXmKDCmiR5QNR9fBmoEgjy3EKukKeiG0YXyHcO1xgjzNCXWazrmBkyiUsvht1N1viGLBQhSum9E1EP2LZEcgTYaO63JV5yECTO1CEmki1S7U-Vr9sS6nurrFp7E Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 247ce86198ec46aa9a566403ccefaa28 Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:03:11.783581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:03:11.785072 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:03:11.785072 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:11.785072 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 247ce86198ec46aa9a566403ccefaa28 Sep 26 18:03:11.785072 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:11.785072 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-VolumesNegativeTest-1540549699-project Sep 26 18:03:11.785072 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:03:11.785072 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:03:11.785072 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 6999c1f707f14c89b1556cdf0f886b53 Sep 26 18:03:11.785072 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-VolumesNegativeTest-1540549699-project Sep 26 18:03:11.785072 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Sep 26 18:03:11.785072 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-199652066", "metadata": {"Type": "work"}}} Sep 26 18:03:11.785072 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: Sep 26 18:03:11.785072 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-199652066', 'metadata': {'Type': 'work'}}}} Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise error Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi '' Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:03:11.786632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 18:03:11.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 18:03:11.789009 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 18:03:11.789009 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:11.789009 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-0033a0ca-1821-446a-812c-c18674b124e8 tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:03:11.789009 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-0033a0ca-1821-446a-812c-c18674b124e8 tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011344 Sep 26 18:03:11.792123 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 2/3] 10.222.0.67 () {60 vars in 1156 bytes} [Mon Sep 26 18:03:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 18:03:11.793317 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=3 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:11.794465 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=3 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:11.795280 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=3 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:11.796220 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=3 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:11.804064 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1a173a8b-fbd7-4668-bad8-fe0773dff2bf tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Calling method '.version_select at 0x7f3a75a059d0>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-1a173a8b-fbd7-4668-bad8-fe0773dff2bf tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] HTTP exception thrown: Volume tempest-invalid-1180572834 could not be found. Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1a173a8b-fbd7-4668-bad8-fe0773dff2bf tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Request method failure captured: Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1180572834 HTTP/1.1 Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMeldCKH8v-ubC3sBOq7-569YQ4YXlfSILRs9KN8lMy3AO4jIc-E4uXmKDCmiR5QNR9fBmoEgjy3EKukKeiG0YXyHcO1xgjzNCXWazrmBkyiUsvht1N1viGLBQhSum9E1EP2LZEcgTYaO63JV5yECTO1CEmki1S7U-Vr9sS6nurrFp7E Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: 247ce86198ec46aa9a566403ccefaa28 Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:03:13.587000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:03:13.589750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:03:13.589750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:13.589750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: 247ce86198ec46aa9a566403ccefaa28 Sep 26 18:03:13.589750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:13.589750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-VolumesNegativeTest-1540549699-project Sep 26 18:03:13.589750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:03:13.589750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:03:13.589750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 6999c1f707f14c89b1556cdf0f886b53 Sep 26 18:03:13.589750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-VolumesNegativeTest-1540549699-project Sep 26 18:03:13.589750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: Sep 26 18:03:13.589750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Volume tempest-invalid-1180572834 could not be found. Sep 26 18:03:13.589750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': 'tempest-invalid-1180572834'} Sep 26 18:03:13.589750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1180572834 could not be found. (HTTP 404) (Request-ID: req-acbc791f-12de-477c-84d8-0fb6eab1692e) Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:13.591461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 18:03:13.593790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1180572834 could not be found. Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:03:13.596095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1180572834 could not be found. Sep 26 18:03:13.598120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:13.598120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:13.598120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:13.598120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:13.598120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:13.598120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:13.598120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:03:13.598120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:03:13.598120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1180572834 could not be found. Sep 26 18:03:13.598120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:13.598120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1a173a8b-fbd7-4668-bad8-fe0773dff2bf tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Returning 404 to user: Volume tempest-invalid-1180572834 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:03:13.598120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1a173a8b-fbd7-4668-bad8-fe0773dff2bf tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1180572834" status: 404 len: 99 microversion: 2.1 time: 1.640775 Sep 26 18:03:13.598120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 2/4] 10.222.0.67 () {58 vars in 1218 bytes} [Mon Sep 26 18:03:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1180572834 => generated 99 bytes in 1643 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 26 18:03:13.599530 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-7d034555-e367-4ceb-9d69-c77de629469c tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007168 Sep 26 18:03:13.599530 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 3/5] 10.222.0.67 () {58 vars in 1140 bytes} [Mon Sep 26 18:03:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 26 18:03:13.600630 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-858a8a8a-4d04-44c3-b3ea-9e20a6c36949 tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004711 Sep 26 18:03:13.600630 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 3/6] 10.222.0.67 () {58 vars in 1137 bytes} [Mon Sep 26 18:03:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 26 18:03:13.601051 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d8f1b538-1a2a-44b5-9d57-0ea8e01c038b tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Calling method '.version_select at 0x7f3a7586d430>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:14.108452 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-d8f1b538-1a2a-44b5-9d57-0ea8e01c038b tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] HTTP exception thrown: Volume c6979c07-7c62-44c6-9fe6-b3ab773309ba could not be found. Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d8f1b538-1a2a-44b5-9d57-0ea8e01c038b tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Request method failure captured: Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: DELETE /compute/v2.1/os-volumes/c6979c07-7c62-44c6-9fe6-b3ab773309ba HTTP/1.1 Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMeldCKH8v-ubC3sBOq7-569YQ4YXlfSILRs9KN8lMy3AO4jIc-E4uXmKDCmiR5QNR9fBmoEgjy3EKukKeiG0YXyHcO1xgjzNCXWazrmBkyiUsvht1N1viGLBQhSum9E1EP2LZEcgTYaO63JV5yECTO1CEmki1S7U-Vr9sS6nurrFp7E Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 247ce86198ec46aa9a566403ccefaa28 Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:03:14.112993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:03:14.114447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:03:14.114447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:14.114447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 247ce86198ec46aa9a566403ccefaa28 Sep 26 18:03:14.114447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:14.114447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-VolumesNegativeTest-1540549699-project Sep 26 18:03:14.114447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:03:14.114447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:03:14.114447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 6999c1f707f14c89b1556cdf0f886b53 Sep 26 18:03:14.114447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-VolumesNegativeTest-1540549699-project Sep 26 18:03:14.114447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: Sep 26 18:03:14.114447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Volume c6979c07-7c62-44c6-9fe6-b3ab773309ba could not be found. Sep 26 18:03:14.114447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': 'c6979c07-7c62-44c6-9fe6-b3ab773309ba'} Sep 26 18:03:14.114447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c6979c07-7c62-44c6-9fe6-b3ab773309ba could not be found. (HTTP 404) (Request-ID: req-129f72c3-5b53-4ae4-8a3c-e9b345335109) Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:14.115294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 18:03:14.116507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c6979c07-7c62-44c6-9fe6-b3ab773309ba could not be found. Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 18:03:14.118045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:03:14.119137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c6979c07-7c62-44c6-9fe6-b3ab773309ba could not be found. Sep 26 18:03:14.119137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:14.119137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:14.119137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:14.119137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:14.119137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:14.119137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:14.119137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:03:14.119137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:03:14.119137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c6979c07-7c62-44c6-9fe6-b3ab773309ba could not be found. Sep 26 18:03:14.119137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:03:14.122828 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d8f1b538-1a2a-44b5-9d57-0ea8e01c038b tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Returning 404 to user: Volume c6979c07-7c62-44c6-9fe6-b3ab773309ba could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:03:14.122828 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d8f1b538-1a2a-44b5-9d57-0ea8e01c038b tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/c6979c07-7c62-44c6-9fe6-b3ab773309ba" status: 404 len: 109 microversion: 2.1 time: 0.656510 Sep 26 18:03:14.127995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 4/7] 10.222.0.67 () {58 vars in 1248 bytes} [Mon Sep 26 18:03:13 2022] DELETE /compute/v2.1/os-volumes/c6979c07-7c62-44c6-9fe6-b3ab773309ba => generated 109 bytes in 664 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:03:14.133968 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8c050a3d-2b5a-450d-b058-1164ed1b4b25 tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Calling method '.version_select at 0x7f3a75797040>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:14.677128 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-8c050a3d-2b5a-450d-b058-1164ed1b4b25 tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] HTTP exception thrown: Volume 66fc5649-2d36-482a-9426-2cc4e96ace84 could not be found. Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8c050a3d-2b5a-450d-b058-1164ed1b4b25 tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Request method failure captured: Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/os-volumes/66fc5649-2d36-482a-9426-2cc4e96ace84 HTTP/1.1 Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMeldCKH8v-ubC3sBOq7-569YQ4YXlfSILRs9KN8lMy3AO4jIc-E4uXmKDCmiR5QNR9fBmoEgjy3EKukKeiG0YXyHcO1xgjzNCXWazrmBkyiUsvht1N1viGLBQhSum9E1EP2LZEcgTYaO63JV5yECTO1CEmki1S7U-Vr9sS6nurrFp7E Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: 247ce86198ec46aa9a566403ccefaa28 Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:03:14.679098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:03:14.693981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/247ce86198ec46aa9a566403ccefaa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:03:14.693981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:14.693981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: 247ce86198ec46aa9a566403ccefaa28 Sep 26 18:03:14.693981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-VolumesNegativeTest-1540549699 Sep 26 18:03:14.693981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-VolumesNegativeTest-1540549699-project Sep 26 18:03:14.693981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:03:14.693981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:03:14.693981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 6999c1f707f14c89b1556cdf0f886b53 Sep 26 18:03:14.693981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-VolumesNegativeTest-1540549699-project Sep 26 18:03:14.693981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: Sep 26 18:03:14.693981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Volume 66fc5649-2d36-482a-9426-2cc4e96ace84 could not be found. Sep 26 18:03:14.693981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': '66fc5649-2d36-482a-9426-2cc4e96ace84'} Sep 26 18:03:14.693981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66fc5649-2d36-482a-9426-2cc4e96ace84 could not be found. (HTTP 404) (Request-ID: req-df7ac921-1006-494e-b1ba-29f1e780353a) Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:14.697835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 18:03:14.699314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66fc5649-2d36-482a-9426-2cc4e96ace84 could not be found. Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 18:03:14.701669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:03:14.702638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66fc5649-2d36-482a-9426-2cc4e96ace84 could not be found. Sep 26 18:03:14.702638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:14.702638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:03:14.702638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:14.702638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:03:14.702638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:03:14.702638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:03:14.702638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:03:14.702638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:03:14.702638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66fc5649-2d36-482a-9426-2cc4e96ace84 could not be found. Sep 26 18:03:14.702638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:03:14.702638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8c050a3d-2b5a-450d-b058-1164ed1b4b25 tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] Returning 404 to user: Volume 66fc5649-2d36-482a-9426-2cc4e96ace84 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:03:14.702638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-8c050a3d-2b5a-450d-b058-1164ed1b4b25 tempest-VolumesNegativeTest-1540549699 tempest-VolumesNegativeTest-1540549699-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/66fc5649-2d36-482a-9426-2cc4e96ace84" status: 404 len: 109 microversion: 2.1 time: 0.554074 Sep 26 18:03:14.702638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1245 bytes} [Mon Sep 26 18:03:14 2022] GET /compute/v2.1/os-volumes/66fc5649-2d36-482a-9426-2cc4e96ace84 => generated 109 bytes in 555 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:03:24.673040 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-7eaf8938-4227-4d17-845a-7a1668f19be2 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Action: 'create', calling method: .version_select at 0x7f3a757f4e50>, body: {"keypair": {"name": "tempest-keypair-127912315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUvwR6ylaAu0oTFIbF4vx/LZTK5JWjqu7U2nSYQIk2BBNjqMR9riJ5THEEny9Fs2XrymeF6rioZNWgDm9cUxKiXHpvb5NHC7C4D19FpB/6MP1vQVeJ7p8KSldiZz1g5Dg=="}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:24.780473 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-7eaf8938-4227-4d17-845a-7a1668f19be2 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Getting quotas for project ffa58ff5197e48709d5c90ec334b9403. Resources: {'key_pairs'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:03:24.789573 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-7eaf8938-4227-4d17-845a-7a1668f19be2 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Getting quotas for user 0bede3a601f941e7abc9fd16983679b2 and project ffa58ff5197e48709d5c90ec334b9403. Resources: {'key_pairs'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:03:25.001502 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-7eaf8938-4227-4d17-845a-7a1668f19be2 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.544064 Sep 26 18:03:25.002600 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 5/9] 10.222.0.67 () {60 vars in 1159 bytes} [Mon Sep 26 18:03:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:29.485292 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-719169989", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452", "networks": [{"uuid": "14afb4e8-c529-4ecb-b70e-20ecdadd3fe6"}]}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:29.832990 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.network.neutron [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] validate_networks() for [('14afb4e8-c529-4ecb-b70e-20ecdadd3fe6', None, None, None, None, None)] {{(pid=121029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:03:30.587925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-63934396", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:30.813248 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.network.neutron [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] validate_networks() for [('45aee833-caf9-4514-8a4b-002783e94737', None, None, None, None, None)] {{(pid=121028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:03:31.598981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Flavor limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:03:31.600342 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Image limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:03:31.601986 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Flavor pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:03:31.602679 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Image pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:03:31.603175 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:03:31.622919 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:31.623504 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:31.624240 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:31.625061 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:31.627012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:31.627012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:31.678629 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Getting quotas for project bcd6fe4cc3554b888bb25819f5fac1e4. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:03:31.689507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Getting quotas for user 14e51ac136874806b4b903235697b404 and project bcd6fe4cc3554b888bb25819f5fac1e4. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:03:31.710715 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Going to run 1 instances... {{(pid=121029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:03:31.714399 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:03:31.978554 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-83cdbd2f-5927-4f79-be2b-f8d5241c7210 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.784783 Sep 26 18:03:31.985359 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 5/10] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:03:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:03:32.002391 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1264891917", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff0911ec-d0cb-47aa-9835-b96611526a51"}], "security_groups": [{"name": "tempest-securitygroup--677342534"}], "key_name": "tempest-keypair-127912315", "user_data": "}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:32.350829 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Flavor limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:03:32.352659 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Image limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:03:32.353451 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Flavor pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:03:32.354004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Image pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:03:32.360480 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:03:32.369480 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.network.neutron [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] validate_networks() for [('ff0911ec-d0cb-47aa-9835-b96611526a51', None, None, None, None, None)] {{(pid=121029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:03:32.380593 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:32.381369 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:32.383019 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:32.384159 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:32.389461 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:32.392329 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:32.426858 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Getting quotas for project 3a15ebd862054a64ac1d739db5adc3a2. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:03:32.432661 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Getting quotas for user 97ed136f68c540abbdaf04cbe34a682e and project 3a15ebd862054a64ac1d739db5adc3a2. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:03:32.450539 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Going to run 1 instances... {{(pid=121028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:03:32.453725 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:03:32.785464 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c4cb4a82-f48d-467b-8525-c8e677d51352 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.736226 Sep 26 18:03:32.801357 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 6/11] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:03:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:03:32.813351 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-fe1102b5-7ed4-450c-adca-65b14093f264 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:32.813975 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-fe1102b5-7ed4-450c-adca-65b14093f264 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:33.083132 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-fe1102b5-7ed4-450c-adca-65b14093f264 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:33.085864 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Flavor limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:03:33.086415 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Image limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:03:33.086762 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Flavor pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:03:33.087182 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Image pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:03:33.087846 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:03:33.099870 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:33.102397 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:33.103523 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:33.104522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:33.105150 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:33.106828 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:33.114829 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-fe1102b5-7ed4-450c-adca-65b14093f264 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1214 microversion: 2.1 time: 0.309751 Sep 26 18:03:33.115579 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 7/12] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:32 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1214 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:33.124401 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-efd2ba93-119f-4876-88be-5854a487f187 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:33.134609 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-efd2ba93-119f-4876-88be-5854a487f187 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:33.154845 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Getting quotas for project ffa58ff5197e48709d5c90ec334b9403. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:03:33.167207 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Getting quotas for user 0bede3a601f941e7abc9fd16983679b2 and project ffa58ff5197e48709d5c90ec334b9403. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:03:33.183551 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Going to run 1 instances... {{(pid=121029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:03:33.186154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:03:33.289066 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-efd2ba93-119f-4876-88be-5854a487f187 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:33.307376 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-efd2ba93-119f-4876-88be-5854a487f187 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1220 microversion: 2.1 time: 0.180849 Sep 26 18:03:33.313554 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 8/13] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:33 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1220 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:33.514002 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b4d3a30e-aa92-49fa-8577-883a27a8c760 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.527019 Sep 26 18:03:33.521113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 6/14] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:03:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:03:33.535180 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e78610f3-1c9d-4c67-9b5c-61d5c0b860b6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:33.535180 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e78610f3-1c9d-4c67-9b5c-61d5c0b860b6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:33.652264 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-943742574", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:33.703367 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e78610f3-1c9d-4c67-9b5c-61d5c0b860b6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:33.716784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e78610f3-1c9d-4c67-9b5c-61d5c0b860b6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1241 microversion: 2.1 time: 0.194304 Sep 26 18:03:33.727658 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 9/15] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:33 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1241 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:33.745249 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.network.neutron [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] validate_networks() for [('45aee833-caf9-4514-8a4b-002783e94737', None, None, None, None, None)] {{(pid=121029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:03:34.157063 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-021e6424-00eb-453b-8652-e6276913f002 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:34.157680 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-021e6424-00eb-453b-8652-e6276913f002 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:34.338369 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-021e6424-00eb-453b-8652-e6276913f002 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:34.347281 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-021e6424-00eb-453b-8652-e6276913f002 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1214 microversion: 2.1 time: 0.193895 Sep 26 18:03:34.356764 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 10/16] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:34 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1214 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:34.690707 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Flavor limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:03:34.691261 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Image limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:03:34.691614 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Flavor pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:03:34.692146 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Image pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:03:34.692956 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:03:34.709594 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:34.710685 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:34.711733 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:34.712443 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:34.713399 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:34.713746 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:34.733265 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Getting quotas for project 3a15ebd862054a64ac1d739db5adc3a2. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:03:34.738158 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Getting quotas for user 97ed136f68c540abbdaf04cbe34a682e and project 3a15ebd862054a64ac1d739db5adc3a2. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:03:34.746682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6ec7cd1a-310c-4f2f-8326-c2958ec38782 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:34.748026 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-6ec7cd1a-310c-4f2f-8326-c2958ec38782 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:34.752642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Going to run 1 instances... {{(pid=121029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:03:34.755310 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:03:34.817323 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6ec7cd1a-310c-4f2f-8326-c2958ec38782 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:34.861043 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-6ec7cd1a-310c-4f2f-8326-c2958ec38782 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1241 microversion: 2.1 time: 0.118614 Sep 26 18:03:34.862320 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 11/17] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:34 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1241 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:35.013689 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-dfc25eed-93ad-40e9-8836-851da68c8da9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.366524 Sep 26 18:03:35.016963 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 7/18] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:03:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 18:03:35.028394 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d8e75742-8e6a-48b3-8a16-eb0d1c70d424 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:35.029384 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d8e75742-8e6a-48b3-8a16-eb0d1c70d424 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:35.108795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d8e75742-8e6a-48b3-8a16-eb0d1c70d424 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:35.117536 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d8e75742-8e6a-48b3-8a16-eb0d1c70d424 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1221 microversion: 2.1 time: 0.092773 Sep 26 18:03:35.119856 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 12/19] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:35 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:35.377687 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7b832c56-370f-4a49-8416-6709b13799ea tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:35.397395 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7b832c56-370f-4a49-8416-6709b13799ea tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:35.467674 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7b832c56-370f-4a49-8416-6709b13799ea tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:35.489284 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7b832c56-370f-4a49-8416-6709b13799ea tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1214 microversion: 2.1 time: 0.116829 Sep 26 18:03:35.490425 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 8/20] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:35 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:35.892433 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1308f1b7-8d3f-4fec-b79c-35251bf1ab20 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:35.893857 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1308f1b7-8d3f-4fec-b79c-35251bf1ab20 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:35.957907 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1308f1b7-8d3f-4fec-b79c-35251bf1ab20 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:35.982199 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1308f1b7-8d3f-4fec-b79c-35251bf1ab20 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1241 microversion: 2.1 time: 0.080013 Sep 26 18:03:35.986312 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 13/21] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:35 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:36.142325 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-66c525bd-bf0c-44ac-b682-fd1e2e565856 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:36.142937 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-66c525bd-bf0c-44ac-b682-fd1e2e565856 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:36.201407 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-66c525bd-bf0c-44ac-b682-fd1e2e565856 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:36.209232 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-66c525bd-bf0c-44ac-b682-fd1e2e565856 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1221 microversion: 2.1 time: 0.070799 Sep 26 18:03:36.209808 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 9/22] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:36 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1221 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:36.515348 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e8537670-74c5-4c8e-902f-47383c7faa88 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:36.515995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e8537670-74c5-4c8e-902f-47383c7faa88 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:36.525292 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e8537670-74c5-4c8e-902f-47383c7faa88 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:36.525847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e8537670-74c5-4c8e-902f-47383c7faa88 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:36.526636 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e8537670-74c5-4c8e-902f-47383c7faa88 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:36.527977 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e8537670-74c5-4c8e-902f-47383c7faa88 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:36.530205 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e8537670-74c5-4c8e-902f-47383c7faa88 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:36.530904 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e8537670-74c5-4c8e-902f-47383c7faa88 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:36.682790 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e8537670-74c5-4c8e-902f-47383c7faa88 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:36.696128 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e8537670-74c5-4c8e-902f-47383c7faa88 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1218 microversion: 2.1 time: 0.184578 Sep 26 18:03:36.696707 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 14/23] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:36 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:37.017574 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8f9fd42b-132f-40fe-8cb5-cfc238f1c0bc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:37.022807 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-8f9fd42b-132f-40fe-8cb5-cfc238f1c0bc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:37.029681 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8f9fd42b-132f-40fe-8cb5-cfc238f1c0bc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:37.031035 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8f9fd42b-132f-40fe-8cb5-cfc238f1c0bc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:37.032063 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8f9fd42b-132f-40fe-8cb5-cfc238f1c0bc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:37.033528 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8f9fd42b-132f-40fe-8cb5-cfc238f1c0bc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:37.034497 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8f9fd42b-132f-40fe-8cb5-cfc238f1c0bc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:37.035214 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8f9fd42b-132f-40fe-8cb5-cfc238f1c0bc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:37.202048 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-8f9fd42b-132f-40fe-8cb5-cfc238f1c0bc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:37.218296 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-8f9fd42b-132f-40fe-8cb5-cfc238f1c0bc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1245 microversion: 2.1 time: 0.206645 Sep 26 18:03:37.219116 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 10/24] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:37 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1245 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:37.236523 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ab63d814-8214-4a7b-92e0-686771111779 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:37.242798 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ab63d814-8214-4a7b-92e0-686771111779 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:37.245239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ab63d814-8214-4a7b-92e0-686771111779 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:37.247409 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ab63d814-8214-4a7b-92e0-686771111779 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:37.249529 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ab63d814-8214-4a7b-92e0-686771111779 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:37.251012 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ab63d814-8214-4a7b-92e0-686771111779 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:37.252101 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ab63d814-8214-4a7b-92e0-686771111779 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:37.253562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ab63d814-8214-4a7b-92e0-686771111779 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:37.332837 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ab63d814-8214-4a7b-92e0-686771111779 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:37.341627 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ab63d814-8214-4a7b-92e0-686771111779 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1225 microversion: 2.1 time: 0.112793 Sep 26 18:03:37.342664 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 15/25] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:37 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:37.718786 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-81a4c0f6-6a99-4501-ad8a-2d05a32e1296 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:37.719495 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-81a4c0f6-6a99-4501-ad8a-2d05a32e1296 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:37.727070 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-81a4c0f6-6a99-4501-ad8a-2d05a32e1296 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:37.727707 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-81a4c0f6-6a99-4501-ad8a-2d05a32e1296 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:37.728346 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-81a4c0f6-6a99-4501-ad8a-2d05a32e1296 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:37.729291 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-81a4c0f6-6a99-4501-ad8a-2d05a32e1296 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:37.729764 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-81a4c0f6-6a99-4501-ad8a-2d05a32e1296 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:37.730200 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-81a4c0f6-6a99-4501-ad8a-2d05a32e1296 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:37.822988 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-81a4c0f6-6a99-4501-ad8a-2d05a32e1296 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:37.831587 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-81a4c0f6-6a99-4501-ad8a-2d05a32e1296 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1218 microversion: 2.1 time: 0.116843 Sep 26 18:03:37.839828 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 11/26] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:37 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:38.243387 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ee2619d5-91de-4ca0-ab33-ad4fb94e7cd7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:38.244050 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ee2619d5-91de-4ca0-ab33-ad4fb94e7cd7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:38.250138 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee2619d5-91de-4ca0-ab33-ad4fb94e7cd7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:38.250632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee2619d5-91de-4ca0-ab33-ad4fb94e7cd7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:38.251078 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee2619d5-91de-4ca0-ab33-ad4fb94e7cd7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:38.251814 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee2619d5-91de-4ca0-ab33-ad4fb94e7cd7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:38.252282 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee2619d5-91de-4ca0-ab33-ad4fb94e7cd7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:38.252711 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee2619d5-91de-4ca0-ab33-ad4fb94e7cd7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:38.326015 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ee2619d5-91de-4ca0-ab33-ad4fb94e7cd7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:38.336099 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ee2619d5-91de-4ca0-ab33-ad4fb94e7cd7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1245 microversion: 2.1 time: 0.096689 Sep 26 18:03:38.337294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 16/27] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:38 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:38.369366 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-65d815c7-f1a8-45c8-a1a4-36542b3354b1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:38.370907 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-65d815c7-f1a8-45c8-a1a4-36542b3354b1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:38.378749 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-65d815c7-f1a8-45c8-a1a4-36542b3354b1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:38.381014 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-65d815c7-f1a8-45c8-a1a4-36542b3354b1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:38.381014 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-65d815c7-f1a8-45c8-a1a4-36542b3354b1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:38.381014 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-65d815c7-f1a8-45c8-a1a4-36542b3354b1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:38.381014 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-65d815c7-f1a8-45c8-a1a4-36542b3354b1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:38.381469 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-65d815c7-f1a8-45c8-a1a4-36542b3354b1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:38.471468 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-65d815c7-f1a8-45c8-a1a4-36542b3354b1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:38.484303 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-65d815c7-f1a8-45c8-a1a4-36542b3354b1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1225 microversion: 2.1 time: 0.119236 Sep 26 18:03:38.487749 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 12/28] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:38 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1225 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:38.863459 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ee3ce748-566a-473a-8d3e-2b87effb5a6c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:38.864161 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ee3ce748-566a-473a-8d3e-2b87effb5a6c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:38.889127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee3ce748-566a-473a-8d3e-2b87effb5a6c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:38.889127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee3ce748-566a-473a-8d3e-2b87effb5a6c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:38.889127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee3ce748-566a-473a-8d3e-2b87effb5a6c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:38.889127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee3ce748-566a-473a-8d3e-2b87effb5a6c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:38.889402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee3ce748-566a-473a-8d3e-2b87effb5a6c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:38.889402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee3ce748-566a-473a-8d3e-2b87effb5a6c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:38.998702 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ee3ce748-566a-473a-8d3e-2b87effb5a6c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:39.032421 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ee3ce748-566a-473a-8d3e-2b87effb5a6c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1218 microversion: 2.1 time: 0.167976 Sep 26 18:03:39.032421 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 17/29] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:38 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:39.387996 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-71fa6805-f84b-41fb-a779-633f9e069036 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:39.389031 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-71fa6805-f84b-41fb-a779-633f9e069036 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:39.395696 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71fa6805-f84b-41fb-a779-633f9e069036 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:39.396495 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71fa6805-f84b-41fb-a779-633f9e069036 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:39.396660 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71fa6805-f84b-41fb-a779-633f9e069036 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:39.398679 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71fa6805-f84b-41fb-a779-633f9e069036 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:39.399294 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71fa6805-f84b-41fb-a779-633f9e069036 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:39.400034 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71fa6805-f84b-41fb-a779-633f9e069036 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:39.478483 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-71fa6805-f84b-41fb-a779-633f9e069036 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:39.486513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-71fa6805-f84b-41fb-a779-633f9e069036 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1237 microversion: 2.1 time: 0.120341 Sep 26 18:03:39.487209 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 13/30] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:39 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1237 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:39.521076 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a1d92475-682a-43f2-99a5-b79a683c8252 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:39.522272 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a1d92475-682a-43f2-99a5-b79a683c8252 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:39.553140 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1d92475-682a-43f2-99a5-b79a683c8252 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:39.554882 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1d92475-682a-43f2-99a5-b79a683c8252 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:39.555768 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1d92475-682a-43f2-99a5-b79a683c8252 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:39.557220 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1d92475-682a-43f2-99a5-b79a683c8252 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:39.558105 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1d92475-682a-43f2-99a5-b79a683c8252 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:39.558742 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1d92475-682a-43f2-99a5-b79a683c8252 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:39.636528 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a1d92475-682a-43f2-99a5-b79a683c8252 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:39.646434 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a1d92475-682a-43f2-99a5-b79a683c8252 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1217 microversion: 2.1 time: 0.131161 Sep 26 18:03:39.647882 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 18/31] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:39 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:40.071690 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-16a02be5-e61d-4884-a81c-56cf733d11cf tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:40.072571 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-16a02be5-e61d-4884-a81c-56cf733d11cf tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:40.079817 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-16a02be5-e61d-4884-a81c-56cf733d11cf tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:40.080652 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-16a02be5-e61d-4884-a81c-56cf733d11cf tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:40.081316 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-16a02be5-e61d-4884-a81c-56cf733d11cf tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:40.082173 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-16a02be5-e61d-4884-a81c-56cf733d11cf tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:40.082747 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-16a02be5-e61d-4884-a81c-56cf733d11cf tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:40.083304 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-16a02be5-e61d-4884-a81c-56cf733d11cf tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:40.187082 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-16a02be5-e61d-4884-a81c-56cf733d11cf tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:40.203075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-16a02be5-e61d-4884-a81c-56cf733d11cf tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1266 microversion: 2.1 time: 0.137670 Sep 26 18:03:40.206093 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 14/32] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:40 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:40.514603 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f247152e-add1-42b5-b552-89290c55e2a0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:40.515217 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f247152e-add1-42b5-b552-89290c55e2a0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:40.521256 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f247152e-add1-42b5-b552-89290c55e2a0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:40.521984 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f247152e-add1-42b5-b552-89290c55e2a0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:40.522712 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f247152e-add1-42b5-b552-89290c55e2a0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:40.523398 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f247152e-add1-42b5-b552-89290c55e2a0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:40.523887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f247152e-add1-42b5-b552-89290c55e2a0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:40.524309 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f247152e-add1-42b5-b552-89290c55e2a0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:40.602337 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f247152e-add1-42b5-b552-89290c55e2a0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:40.611129 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f247152e-add1-42b5-b552-89290c55e2a0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1237 microversion: 2.1 time: 0.100569 Sep 26 18:03:40.612097 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 19/33] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:40 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:40.670546 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7eb6c0a6-a9ae-481f-808a-c2cf5f7284b7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:40.671153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7eb6c0a6-a9ae-481f-808a-c2cf5f7284b7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:40.677451 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7eb6c0a6-a9ae-481f-808a-c2cf5f7284b7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:40.678111 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7eb6c0a6-a9ae-481f-808a-c2cf5f7284b7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:40.678596 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7eb6c0a6-a9ae-481f-808a-c2cf5f7284b7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:40.679295 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7eb6c0a6-a9ae-481f-808a-c2cf5f7284b7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:40.679871 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7eb6c0a6-a9ae-481f-808a-c2cf5f7284b7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:40.680295 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7eb6c0a6-a9ae-481f-808a-c2cf5f7284b7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:40.779186 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7eb6c0a6-a9ae-481f-808a-c2cf5f7284b7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:40.793979 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7eb6c0a6-a9ae-481f-808a-c2cf5f7284b7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1217 microversion: 2.1 time: 0.127346 Sep 26 18:03:40.812312 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 15/34] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:40 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1217 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:41.240318 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b6af9236-0e2b-4453-a46c-81057bf4853a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:41.241523 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b6af9236-0e2b-4453-a46c-81057bf4853a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:41.254457 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6af9236-0e2b-4453-a46c-81057bf4853a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:41.254954 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6af9236-0e2b-4453-a46c-81057bf4853a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:41.258026 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6af9236-0e2b-4453-a46c-81057bf4853a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:41.262138 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6af9236-0e2b-4453-a46c-81057bf4853a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:41.262651 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6af9236-0e2b-4453-a46c-81057bf4853a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:41.264698 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6af9236-0e2b-4453-a46c-81057bf4853a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:41.377744 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b6af9236-0e2b-4453-a46c-81057bf4853a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:41.388426 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b6af9236-0e2b-4453-a46c-81057bf4853a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1284 microversion: 2.1 time: 0.152268 Sep 26 18:03:41.388994 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 20/35] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:41 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:41.637217 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b060c626-2e00-4757-87aa-3f7de4327461 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:41.638100 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b060c626-2e00-4757-87aa-3f7de4327461 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:41.648326 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b060c626-2e00-4757-87aa-3f7de4327461 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:41.649216 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b060c626-2e00-4757-87aa-3f7de4327461 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:41.657017 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b060c626-2e00-4757-87aa-3f7de4327461 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:41.658105 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b060c626-2e00-4757-87aa-3f7de4327461 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:41.658794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b060c626-2e00-4757-87aa-3f7de4327461 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:41.659511 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b060c626-2e00-4757-87aa-3f7de4327461 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:41.747248 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b060c626-2e00-4757-87aa-3f7de4327461 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:41.755441 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b060c626-2e00-4757-87aa-3f7de4327461 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1237 microversion: 2.1 time: 0.123868 Sep 26 18:03:41.756377 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 16/36] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:41 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1237 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:41.826045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3420629b-6bc2-42d1-a198-892c2b677917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:41.826773 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-3420629b-6bc2-42d1-a198-892c2b677917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:41.841572 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3420629b-6bc2-42d1-a198-892c2b677917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:41.843919 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3420629b-6bc2-42d1-a198-892c2b677917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:41.844651 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3420629b-6bc2-42d1-a198-892c2b677917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:41.845396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3420629b-6bc2-42d1-a198-892c2b677917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:41.848270 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3420629b-6bc2-42d1-a198-892c2b677917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:41.848775 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3420629b-6bc2-42d1-a198-892c2b677917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:42.019699 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3420629b-6bc2-42d1-a198-892c2b677917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:42.029625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-3420629b-6bc2-42d1-a198-892c2b677917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1217 microversion: 2.1 time: 0.211975 Sep 26 18:03:42.050184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 21/37] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:41 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1217 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:42.417168 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-adefd434-add9-4c2b-a2c5-2c5672f14c46 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:42.417979 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-adefd434-add9-4c2b-a2c5-2c5672f14c46 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:42.435370 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-adefd434-add9-4c2b-a2c5-2c5672f14c46 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:42.438342 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-adefd434-add9-4c2b-a2c5-2c5672f14c46 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:42.440155 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-adefd434-add9-4c2b-a2c5-2c5672f14c46 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:42.447724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-adefd434-add9-4c2b-a2c5-2c5672f14c46 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:42.449522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-adefd434-add9-4c2b-a2c5-2c5672f14c46 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:42.450695 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-adefd434-add9-4c2b-a2c5-2c5672f14c46 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:42.782951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b4ed69ee-6253-4f1a-8aed-2f30fe140ffa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:42.783568 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b4ed69ee-6253-4f1a-8aed-2f30fe140ffa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:42.793885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=2 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:42.795549 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4ed69ee-6253-4f1a-8aed-2f30fe140ffa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:42.799586 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4ed69ee-6253-4f1a-8aed-2f30fe140ffa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:42.800267 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4ed69ee-6253-4f1a-8aed-2f30fe140ffa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:42.805094 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4ed69ee-6253-4f1a-8aed-2f30fe140ffa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:42.805610 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4ed69ee-6253-4f1a-8aed-2f30fe140ffa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:42.806070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4ed69ee-6253-4f1a-8aed-2f30fe140ffa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:42.901082 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-adefd434-add9-4c2b-a2c5-2c5672f14c46 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:42.916361 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b4ed69ee-6253-4f1a-8aed-2f30fe140ffa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:42.924649 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b4ed69ee-6253-4f1a-8aed-2f30fe140ffa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1237 microversion: 2.1 time: 0.145363 Sep 26 18:03:42.925303 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 22/38] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:42 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1237 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:42.937614 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-adefd434-add9-4c2b-a2c5-2c5672f14c46 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.525140 Sep 26 18:03:42.950533 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 17/39] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:42 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:43.081429 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8138469c-c1f4-4864-853a-c7c23d58a70c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:43.082052 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-8138469c-c1f4-4864-853a-c7c23d58a70c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:43.091906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8138469c-c1f4-4864-853a-c7c23d58a70c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:43.092408 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8138469c-c1f4-4864-853a-c7c23d58a70c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:43.092850 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8138469c-c1f4-4864-853a-c7c23d58a70c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:43.099158 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8138469c-c1f4-4864-853a-c7c23d58a70c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:43.108380 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8138469c-c1f4-4864-853a-c7c23d58a70c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:43.109290 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8138469c-c1f4-4864-853a-c7c23d58a70c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:43.250804 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8138469c-c1f4-4864-853a-c7c23d58a70c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:43.273136 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8138469c-c1f4-4864-853a-c7c23d58a70c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1273 microversion: 2.1 time: 0.195965 Sep 26 18:03:43.273739 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 23/40] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:43 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1273 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:43.968918 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ebf41852-617b-4671-886b-0efcffd8bfc9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:43.969774 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ebf41852-617b-4671-886b-0efcffd8bfc9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:43.980216 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ebf41852-617b-4671-886b-0efcffd8bfc9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:43.980720 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ebf41852-617b-4671-886b-0efcffd8bfc9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:43.981147 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ebf41852-617b-4671-886b-0efcffd8bfc9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:43.982410 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ebf41852-617b-4671-886b-0efcffd8bfc9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:43.983049 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ebf41852-617b-4671-886b-0efcffd8bfc9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:43.983618 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ebf41852-617b-4671-886b-0efcffd8bfc9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:44.001716 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8c19c73e-eda2-43fd-83d4-75c42ff4adaa tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:44.002547 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-8c19c73e-eda2-43fd-83d4-75c42ff4adaa tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:44.010701 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8c19c73e-eda2-43fd-83d4-75c42ff4adaa tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:44.011479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8c19c73e-eda2-43fd-83d4-75c42ff4adaa tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:44.012147 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8c19c73e-eda2-43fd-83d4-75c42ff4adaa tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:44.013120 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8c19c73e-eda2-43fd-83d4-75c42ff4adaa tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:44.013662 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8c19c73e-eda2-43fd-83d4-75c42ff4adaa tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:44.014167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8c19c73e-eda2-43fd-83d4-75c42ff4adaa tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:44.065958 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ebf41852-617b-4671-886b-0efcffd8bfc9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:44.074453 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ebf41852-617b-4671-886b-0efcffd8bfc9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1237 microversion: 2.1 time: 0.111494 Sep 26 18:03:44.075460 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 18/41] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:43 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1237 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:44.276815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8c19c73e-eda2-43fd-83d4-75c42ff4adaa tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:44.293641 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8c19c73e-eda2-43fd-83d4-75c42ff4adaa tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.295017 Sep 26 18:03:44.295838 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 24/42] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:43 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:44.315597 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-72da4913-59b4-4972-8c97-dde04685f777 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:44.317961 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-72da4913-59b4-4972-8c97-dde04685f777 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:44.324077 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-72da4913-59b4-4972-8c97-dde04685f777 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:44.324585 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-72da4913-59b4-4972-8c97-dde04685f777 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:44.325019 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-72da4913-59b4-4972-8c97-dde04685f777 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:44.325930 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-72da4913-59b4-4972-8c97-dde04685f777 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:44.326657 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-72da4913-59b4-4972-8c97-dde04685f777 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:44.327283 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-72da4913-59b4-4972-8c97-dde04685f777 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:44.573740 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-72da4913-59b4-4972-8c97-dde04685f777 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:44.582924 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-72da4913-59b4-4972-8c97-dde04685f777 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1273 microversion: 2.1 time: 0.290628 Sep 26 18:03:44.584308 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 19/43] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:44 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1273 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:45.099767 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-dc10d9da-626c-4833-9f48-bc55095e31ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:45.101000 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-dc10d9da-626c-4833-9f48-bc55095e31ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:45.107670 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dc10d9da-626c-4833-9f48-bc55095e31ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:45.108178 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dc10d9da-626c-4833-9f48-bc55095e31ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:45.108608 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dc10d9da-626c-4833-9f48-bc55095e31ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:45.109478 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dc10d9da-626c-4833-9f48-bc55095e31ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:45.109942 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dc10d9da-626c-4833-9f48-bc55095e31ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:45.110353 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dc10d9da-626c-4833-9f48-bc55095e31ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:45.192859 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-dc10d9da-626c-4833-9f48-bc55095e31ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:45.201273 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-dc10d9da-626c-4833-9f48-bc55095e31ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1237 microversion: 2.1 time: 0.105557 Sep 26 18:03:45.201848 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 25/44] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:45 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1237 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:45.322820 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-df544c89-d0fb-4315-9126-471f659b5752 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:45.324097 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-df544c89-d0fb-4315-9126-471f659b5752 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:45.329440 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=6 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:45.335812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-df544c89-d0fb-4315-9126-471f659b5752 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:45.336316 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-df544c89-d0fb-4315-9126-471f659b5752 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:45.337669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-df544c89-d0fb-4315-9126-471f659b5752 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:45.338407 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-df544c89-d0fb-4315-9126-471f659b5752 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:45.338870 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-df544c89-d0fb-4315-9126-471f659b5752 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:45.339306 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-df544c89-d0fb-4315-9126-471f659b5752 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:45.519036 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-df544c89-d0fb-4315-9126-471f659b5752 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:45.532149 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-df544c89-d0fb-4315-9126-471f659b5752 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.213519 Sep 26 18:03:45.533050 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 20/45] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:45 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:45.608643 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-22d029e1-16ec-4553-bb59-c279c4e2c14a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:45.609886 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-22d029e1-16ec-4553-bb59-c279c4e2c14a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:45.622970 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-22d029e1-16ec-4553-bb59-c279c4e2c14a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:45.624127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-22d029e1-16ec-4553-bb59-c279c4e2c14a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:45.624625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-22d029e1-16ec-4553-bb59-c279c4e2c14a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:45.625722 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-22d029e1-16ec-4553-bb59-c279c4e2c14a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:45.626598 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-22d029e1-16ec-4553-bb59-c279c4e2c14a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:45.627923 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-22d029e1-16ec-4553-bb59-c279c4e2c14a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:45.748944 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-22d029e1-16ec-4553-bb59-c279c4e2c14a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:45.748944 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-22d029e1-16ec-4553-bb59-c279c4e2c14a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1273 microversion: 2.1 time: 0.124456 Sep 26 18:03:45.748944 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 26/46] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:45 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1273 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:46.225971 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9c06c299-de4c-4c09-b1f0-f922fb07170a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:46.227924 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9c06c299-de4c-4c09-b1f0-f922fb07170a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:46.229612 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=22 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:46.238089 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9c06c299-de4c-4c09-b1f0-f922fb07170a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:46.238802 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9c06c299-de4c-4c09-b1f0-f922fb07170a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:46.239477 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9c06c299-de4c-4c09-b1f0-f922fb07170a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:46.240810 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9c06c299-de4c-4c09-b1f0-f922fb07170a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:46.241483 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9c06c299-de4c-4c09-b1f0-f922fb07170a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:46.242138 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9c06c299-de4c-4c09-b1f0-f922fb07170a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:46.327434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9c06c299-de4c-4c09-b1f0-f922fb07170a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:46.340969 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9c06c299-de4c-4c09-b1f0-f922fb07170a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1237 microversion: 2.1 time: 0.119375 Sep 26 18:03:46.341650 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 21/47] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:46 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1237 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:46.558095 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1146d2cb-9749-4dc8-ae5e-a24525ecef8f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:46.558573 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1146d2cb-9749-4dc8-ae5e-a24525ecef8f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:46.560605 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=24 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:46.582423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1146d2cb-9749-4dc8-ae5e-a24525ecef8f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:46.582423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1146d2cb-9749-4dc8-ae5e-a24525ecef8f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:46.582423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1146d2cb-9749-4dc8-ae5e-a24525ecef8f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:46.591934 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1146d2cb-9749-4dc8-ae5e-a24525ecef8f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:46.592607 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1146d2cb-9749-4dc8-ae5e-a24525ecef8f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:46.593000 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1146d2cb-9749-4dc8-ae5e-a24525ecef8f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:46.767636 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c60a029f-4062-4496-8f3b-1d2673f6333a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:46.768581 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c60a029f-4062-4496-8f3b-1d2673f6333a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:46.779396 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c60a029f-4062-4496-8f3b-1d2673f6333a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:46.779922 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c60a029f-4062-4496-8f3b-1d2673f6333a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:46.786390 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c60a029f-4062-4496-8f3b-1d2673f6333a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:46.786390 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c60a029f-4062-4496-8f3b-1d2673f6333a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:46.786390 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c60a029f-4062-4496-8f3b-1d2673f6333a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:46.786390 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c60a029f-4062-4496-8f3b-1d2673f6333a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:46.792410 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1146d2cb-9749-4dc8-ae5e-a24525ecef8f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:46.800898 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1146d2cb-9749-4dc8-ae5e-a24525ecef8f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.247480 Sep 26 18:03:46.801478 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 27/48] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:46 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:46.883429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c60a029f-4062-4496-8f3b-1d2673f6333a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:46.901499 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c60a029f-4062-4496-8f3b-1d2673f6333a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1273 microversion: 2.1 time: 0.139754 Sep 26 18:03:46.902106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 22/49] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:46 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:47.369753 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-83c1474f-0157-4888-9484-5f29dff9ed64 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:47.370397 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-83c1474f-0157-4888-9484-5f29dff9ed64 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:47.377257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83c1474f-0157-4888-9484-5f29dff9ed64 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:47.377747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83c1474f-0157-4888-9484-5f29dff9ed64 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:47.378175 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83c1474f-0157-4888-9484-5f29dff9ed64 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:47.379045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83c1474f-0157-4888-9484-5f29dff9ed64 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:47.379696 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83c1474f-0157-4888-9484-5f29dff9ed64 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:47.380122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83c1474f-0157-4888-9484-5f29dff9ed64 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:47.447701 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-83c1474f-0157-4888-9484-5f29dff9ed64 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:47.455918 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-83c1474f-0157-4888-9484-5f29dff9ed64 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1237 microversion: 2.1 time: 0.090998 Sep 26 18:03:47.456722 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 28/50] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:47 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:47.828499 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-eaf24f69-e124-4912-a39f-6dbbc5a12849 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:47.829411 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-eaf24f69-e124-4912-a39f-6dbbc5a12849 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:47.836877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eaf24f69-e124-4912-a39f-6dbbc5a12849 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:47.837591 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eaf24f69-e124-4912-a39f-6dbbc5a12849 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:47.838131 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eaf24f69-e124-4912-a39f-6dbbc5a12849 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:47.839070 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eaf24f69-e124-4912-a39f-6dbbc5a12849 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:47.839933 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eaf24f69-e124-4912-a39f-6dbbc5a12849 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:47.840537 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eaf24f69-e124-4912-a39f-6dbbc5a12849 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:47.925361 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-413d6cd1-bef8-445e-a9e6-cb9c5c9ed958 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:47.926207 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-413d6cd1-bef8-445e-a9e6-cb9c5c9ed958 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:47.939629 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-413d6cd1-bef8-445e-a9e6-cb9c5c9ed958 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:47.940486 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-413d6cd1-bef8-445e-a9e6-cb9c5c9ed958 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:47.955435 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-413d6cd1-bef8-445e-a9e6-cb9c5c9ed958 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:47.956449 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-413d6cd1-bef8-445e-a9e6-cb9c5c9ed958 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:47.956948 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-413d6cd1-bef8-445e-a9e6-cb9c5c9ed958 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:47.957389 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-413d6cd1-bef8-445e-a9e6-cb9c5c9ed958 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:48.059363 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-413d6cd1-bef8-445e-a9e6-cb9c5c9ed958 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:48.061705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-eaf24f69-e124-4912-a39f-6dbbc5a12849 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:48.068256 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-413d6cd1-bef8-445e-a9e6-cb9c5c9ed958 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1273 microversion: 2.1 time: 0.147752 Sep 26 18:03:48.068993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 29/51] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:47 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:48.071445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-eaf24f69-e124-4912-a39f-6dbbc5a12849 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.247215 Sep 26 18:03:48.084875 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 23/52] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:47 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:48.485346 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-83a91d1d-7d9b-446e-b419-b834aab2d9cf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:48.486966 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-83a91d1d-7d9b-446e-b419-b834aab2d9cf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:48.498092 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83a91d1d-7d9b-446e-b419-b834aab2d9cf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:48.498585 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83a91d1d-7d9b-446e-b419-b834aab2d9cf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:48.499016 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83a91d1d-7d9b-446e-b419-b834aab2d9cf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:48.499825 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83a91d1d-7d9b-446e-b419-b834aab2d9cf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:48.500387 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83a91d1d-7d9b-446e-b419-b834aab2d9cf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:48.501001 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83a91d1d-7d9b-446e-b419-b834aab2d9cf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:48.509840 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=100 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:48.587951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-83a91d1d-7d9b-446e-b419-b834aab2d9cf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:48.596294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-83a91d1d-7d9b-446e-b419-b834aab2d9cf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1237 microversion: 2.1 time: 0.115259 Sep 26 18:03:48.599772 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 30/53] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:48 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1237 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:49.102822 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-15268314-731d-4f51-b51f-2bbb8706a7c5 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:49.105981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-742d24a2-4195-4a59-b609-4dd01d9325ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:49.106617 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-742d24a2-4195-4a59-b609-4dd01d9325ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:49.107881 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-15268314-731d-4f51-b51f-2bbb8706a7c5 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:49.126697 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15268314-731d-4f51-b51f-2bbb8706a7c5 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:49.127520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-742d24a2-4195-4a59-b609-4dd01d9325ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:49.128320 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-742d24a2-4195-4a59-b609-4dd01d9325ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:49.129035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15268314-731d-4f51-b51f-2bbb8706a7c5 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:49.129688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-742d24a2-4195-4a59-b609-4dd01d9325ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:49.130562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15268314-731d-4f51-b51f-2bbb8706a7c5 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:49.131885 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-742d24a2-4195-4a59-b609-4dd01d9325ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:49.132504 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-742d24a2-4195-4a59-b609-4dd01d9325ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:49.132809 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15268314-731d-4f51-b51f-2bbb8706a7c5 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:49.133531 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15268314-731d-4f51-b51f-2bbb8706a7c5 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:49.133958 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15268314-731d-4f51-b51f-2bbb8706a7c5 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:49.134737 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-742d24a2-4195-4a59-b609-4dd01d9325ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:49.289327 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-742d24a2-4195-4a59-b609-4dd01d9325ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:49.313749 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-742d24a2-4195-4a59-b609-4dd01d9325ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1273 microversion: 2.1 time: 0.207371 Sep 26 18:03:49.316323 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 24/54] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:49 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1273 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:49.564136 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-15268314-731d-4f51-b51f-2bbb8706a7c5 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:49.574935 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-15268314-731d-4f51-b51f-2bbb8706a7c5 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.480171 Sep 26 18:03:49.583913 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 31/55] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:49 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:49.622846 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-71fdc187-523b-4c05-82aa-61c442b88b4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:49.624541 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-71fdc187-523b-4c05-82aa-61c442b88b4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:49.633256 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71fdc187-523b-4c05-82aa-61c442b88b4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:49.634979 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71fdc187-523b-4c05-82aa-61c442b88b4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:49.636021 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71fdc187-523b-4c05-82aa-61c442b88b4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:49.637013 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71fdc187-523b-4c05-82aa-61c442b88b4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:49.637691 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71fdc187-523b-4c05-82aa-61c442b88b4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:49.638470 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71fdc187-523b-4c05-82aa-61c442b88b4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:49.686673 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=100 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:49.797441 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-71fdc187-523b-4c05-82aa-61c442b88b4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:49.813007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-71fdc187-523b-4c05-82aa-61c442b88b4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1237 microversion: 2.1 time: 0.197321 Sep 26 18:03:49.825000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 25/56] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:49 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1237 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:50.341253 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8404e545-4998-4839-9b25-085d5421d93e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:50.341862 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-8404e545-4998-4839-9b25-085d5421d93e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:50.358696 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8404e545-4998-4839-9b25-085d5421d93e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:50.359433 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8404e545-4998-4839-9b25-085d5421d93e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:50.361522 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8404e545-4998-4839-9b25-085d5421d93e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:50.364761 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8404e545-4998-4839-9b25-085d5421d93e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:50.366098 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8404e545-4998-4839-9b25-085d5421d93e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:50.373631 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8404e545-4998-4839-9b25-085d5421d93e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:50.601466 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b32a9483-8fcc-4d0e-b84d-9fb6f31ab4e0 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:50.603682 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b32a9483-8fcc-4d0e-b84d-9fb6f31ab4e0 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:50.613749 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8404e545-4998-4839-9b25-085d5421d93e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:50.640772 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8404e545-4998-4839-9b25-085d5421d93e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1281 microversion: 2.1 time: 0.303837 Sep 26 18:03:50.641350 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 32/57] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:50 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1281 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:50.651168 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b32a9483-8fcc-4d0e-b84d-9fb6f31ab4e0 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:50.653939 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b32a9483-8fcc-4d0e-b84d-9fb6f31ab4e0 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:50.656113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b32a9483-8fcc-4d0e-b84d-9fb6f31ab4e0 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:50.657326 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b32a9483-8fcc-4d0e-b84d-9fb6f31ab4e0 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:50.663488 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b32a9483-8fcc-4d0e-b84d-9fb6f31ab4e0 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:50.664236 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b32a9483-8fcc-4d0e-b84d-9fb6f31ab4e0 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:50.843924 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b449293d-d66e-4790-8603-ca36d8c30a38 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:50.844642 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b449293d-d66e-4790-8603-ca36d8c30a38 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:50.857868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b449293d-d66e-4790-8603-ca36d8c30a38 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:50.860181 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b449293d-d66e-4790-8603-ca36d8c30a38 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:50.861398 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b449293d-d66e-4790-8603-ca36d8c30a38 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:50.870833 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b449293d-d66e-4790-8603-ca36d8c30a38 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:50.870833 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b449293d-d66e-4790-8603-ca36d8c30a38 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:50.870833 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b449293d-d66e-4790-8603-ca36d8c30a38 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:51.069509 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b449293d-d66e-4790-8603-ca36d8c30a38 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:51.088557 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b449293d-d66e-4790-8603-ca36d8c30a38 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1293 microversion: 2.1 time: 0.249393 Sep 26 18:03:51.091569 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 33/58] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:50 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1293 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:51.230092 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b32a9483-8fcc-4d0e-b84d-9fb6f31ab4e0 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:51.243217 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b32a9483-8fcc-4d0e-b84d-9fb6f31ab4e0 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.646433 Sep 26 18:03:51.261288 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 26/59] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:50 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:51.674242 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-cfbe1499-b5f6-4509-99d3-890cd99ca684 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:51.675854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-cfbe1499-b5f6-4509-99d3-890cd99ca684 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:51.708143 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cfbe1499-b5f6-4509-99d3-890cd99ca684 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:51.711061 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cfbe1499-b5f6-4509-99d3-890cd99ca684 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:51.713237 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cfbe1499-b5f6-4509-99d3-890cd99ca684 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:51.716192 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cfbe1499-b5f6-4509-99d3-890cd99ca684 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:51.718054 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cfbe1499-b5f6-4509-99d3-890cd99ca684 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:51.732654 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cfbe1499-b5f6-4509-99d3-890cd99ca684 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:51.974425 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-cfbe1499-b5f6-4509-99d3-890cd99ca684 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:51.991971 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-cfbe1499-b5f6-4509-99d3-890cd99ca684 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1279 microversion: 2.1 time: 0.321432 Sep 26 18:03:51.992658 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 34/60] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:51 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1279 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:52.116914 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-aaf8120c-5739-4737-8f6c-c743d00e66ac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:52.117604 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-aaf8120c-5739-4737-8f6c-c743d00e66ac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:52.134135 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-aaf8120c-5739-4737-8f6c-c743d00e66ac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:52.136627 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-aaf8120c-5739-4737-8f6c-c743d00e66ac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:52.137433 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-aaf8120c-5739-4737-8f6c-c743d00e66ac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:52.146908 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-aaf8120c-5739-4737-8f6c-c743d00e66ac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:52.147548 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-aaf8120c-5739-4737-8f6c-c743d00e66ac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:52.148233 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-aaf8120c-5739-4737-8f6c-c743d00e66ac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:52.268757 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-bc517f57-3385-48c4-9231-23e020aa8bfc req-526a9a9a-3b5b-4cad-9b1b-7b3e9faf7ddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f92dd8f8-d04b-4fb0-804a-8842bd4c60c9", "tag": "88eb2714-0a5c-49b3-aebb-0b129916ee37"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:52.305036 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:52.308196 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-bc517f57-3385-48c4-9231-23e020aa8bfc req-526a9a9a-3b5b-4cad-9b1b-7b3e9faf7ddc service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:52.308849 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-bc517f57-3385-48c4-9231-23e020aa8bfc req-526a9a9a-3b5b-4cad-9b1b-7b3e9faf7ddc service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:52.309617 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-bc517f57-3385-48c4-9231-23e020aa8bfc req-526a9a9a-3b5b-4cad-9b1b-7b3e9faf7ddc service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:52.351837 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-bc517f57-3385-48c4-9231-23e020aa8bfc req-526a9a9a-3b5b-4cad-9b1b-7b3e9faf7ddc service nova] Creating event network-changed:88eb2714-0a5c-49b3-aebb-0b129916ee37 for instance f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 on hv-cinder-85931 Sep 26 18:03:52.360378 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-bc517f57-3385-48c4-9231-23e020aa8bfc req-526a9a9a-3b5b-4cad-9b1b-7b3e9faf7ddc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 26 18:03:52.361180 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-bc517f57-3385-48c4-9231-23e020aa8bfc req-526a9a9a-3b5b-4cad-9b1b-7b3e9faf7ddc service nova] Acquired lock "compute-rpcapi-router" {{(pid=121028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 26 18:03:52.363020 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-957bf0d6-96f0-4883-84cc-3e4228e80300 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:52.363506 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-957bf0d6-96f0-4883-84cc-3e4228e80300 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:52.364200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-957bf0d6-96f0-4883-84cc-3e4228e80300 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:52.365161 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-957bf0d6-96f0-4883-84cc-3e4228e80300 None None] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:52.366397 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-957bf0d6-96f0-4883-84cc-3e4228e80300 None None] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:52.367023 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-957bf0d6-96f0-4883-84cc-3e4228e80300 None None] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:52.375978 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-aaf8120c-5739-4737-8f6c-c743d00e66ac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:52.379559 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.compute.rpcapi [None req-957bf0d6-96f0-4883-84cc-3e4228e80300 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 26 18:03:52.380771 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-957bf0d6-96f0-4883-84cc-3e4228e80300 None None] Releasing lock "compute-rpcapi-router" {{(pid=121028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 26 18:03:52.403698 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-aaf8120c-5739-4737-8f6c-c743d00e66ac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1301 microversion: 2.1 time: 0.282818 Sep 26 18:03:52.419829 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 27/61] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:52 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1301 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:52.436184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-957bf0d6-96f0-4883-84cc-3e4228e80300 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.309891 Sep 26 18:03:52.436184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 35/62] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:03:52.440765 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-541bc0b4-31d0-4d5b-a7dc-ce525ab5e3a1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:52.447283 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-541bc0b4-31d0-4d5b-a7dc-ce525ab5e3a1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:52.463383 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-541bc0b4-31d0-4d5b-a7dc-ce525ab5e3a1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:52.465040 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-541bc0b4-31d0-4d5b-a7dc-ce525ab5e3a1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:52.467318 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-541bc0b4-31d0-4d5b-a7dc-ce525ab5e3a1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:52.472267 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-541bc0b4-31d0-4d5b-a7dc-ce525ab5e3a1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:52.473485 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-541bc0b4-31d0-4d5b-a7dc-ce525ab5e3a1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:52.474442 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-541bc0b4-31d0-4d5b-a7dc-ce525ab5e3a1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:53.044647 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-599bc23f-8af5-4d25-b4c4-2afadf77d8ef tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:53.048350 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-599bc23f-8af5-4d25-b4c4-2afadf77d8ef tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:53.061224 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-599bc23f-8af5-4d25-b4c4-2afadf77d8ef tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:53.062474 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-599bc23f-8af5-4d25-b4c4-2afadf77d8ef tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:53.063137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-599bc23f-8af5-4d25-b4c4-2afadf77d8ef tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:53.064118 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-599bc23f-8af5-4d25-b4c4-2afadf77d8ef tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:53.065525 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-599bc23f-8af5-4d25-b4c4-2afadf77d8ef tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:53.067040 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-599bc23f-8af5-4d25-b4c4-2afadf77d8ef tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:53.483963 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-541bc0b4-31d0-4d5b-a7dc-ce525ab5e3a1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:53.507405 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-541bc0b4-31d0-4d5b-a7dc-ce525ab5e3a1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 1.078750 Sep 26 18:03:53.551323 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 28/63] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:52 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:53.983358 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-f1893410-42c6-41d3-99e1-9efaba8f8531 req-cfde283f-0f80-42b5-b8d2-3630e8a5295b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d3e0a96-a5c5-43b1-97d6-172536258bc4", "tag": "d0137809-e085-4d58-a7ea-c00ace0e5fb0"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:54.017296 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-f1893410-42c6-41d3-99e1-9efaba8f8531 req-cfde283f-0f80-42b5-b8d2-3630e8a5295b service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:54.019705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-f1893410-42c6-41d3-99e1-9efaba8f8531 req-cfde283f-0f80-42b5-b8d2-3630e8a5295b service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:54.021331 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-f1893410-42c6-41d3-99e1-9efaba8f8531 req-cfde283f-0f80-42b5-b8d2-3630e8a5295b service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:54.077816 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-f1893410-42c6-41d3-99e1-9efaba8f8531 req-cfde283f-0f80-42b5-b8d2-3630e8a5295b service nova] Creating event network-changed:d0137809-e085-4d58-a7ea-c00ace0e5fb0 for instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 on hv-cinder-85931 Sep 26 18:03:54.078608 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-f1893410-42c6-41d3-99e1-9efaba8f8531 req-cfde283f-0f80-42b5-b8d2-3630e8a5295b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 26 18:03:54.079173 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-f1893410-42c6-41d3-99e1-9efaba8f8531 req-cfde283f-0f80-42b5-b8d2-3630e8a5295b service nova] Acquired lock "compute-rpcapi-router" {{(pid=121029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 26 18:03:54.080561 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bdf70167-3b72-487a-8314-1bf272573565 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:54.081042 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bdf70167-3b72-487a-8314-1bf272573565 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:54.081669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bdf70167-3b72-487a-8314-1bf272573565 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:54.082669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bdf70167-3b72-487a-8314-1bf272573565 None None] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:54.083385 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bdf70167-3b72-487a-8314-1bf272573565 None None] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:54.084270 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bdf70167-3b72-487a-8314-1bf272573565 None None] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:54.097201 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.compute.rpcapi [None req-bdf70167-3b72-487a-8314-1bf272573565 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 26 18:03:54.097552 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bdf70167-3b72-487a-8314-1bf272573565 None None] Releasing lock "compute-rpcapi-router" {{(pid=121029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 26 18:03:54.123111 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bdf70167-3b72-487a-8314-1bf272573565 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.569743 Sep 26 18:03:54.124270 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 29/64] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:54.130059 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-00ebaf9d-ace6-4176-9783-c8dddf46c234 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:54.131078 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-00ebaf9d-ace6-4176-9783-c8dddf46c234 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:54.137510 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:54.139447 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00ebaf9d-ace6-4176-9783-c8dddf46c234 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:54.140149 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00ebaf9d-ace6-4176-9783-c8dddf46c234 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:54.140786 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00ebaf9d-ace6-4176-9783-c8dddf46c234 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:54.141893 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00ebaf9d-ace6-4176-9783-c8dddf46c234 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:54.142551 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00ebaf9d-ace6-4176-9783-c8dddf46c234 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:54.143252 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00ebaf9d-ace6-4176-9783-c8dddf46c234 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:54.246915 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-599bc23f-8af5-4d25-b4c4-2afadf77d8ef tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:54.268492 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-599bc23f-8af5-4d25-b4c4-2afadf77d8ef tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 1.235492 Sep 26 18:03:54.269534 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 36/65] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:53 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:54.486484 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-00ebaf9d-ace6-4176-9783-c8dddf46c234 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:54.538519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-00ebaf9d-ace6-4176-9783-c8dddf46c234 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1299 microversion: 2.1 time: 0.409529 Sep 26 18:03:54.540559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 30/66] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:54 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1299 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:54.561348 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-fe9f7fd5-815f-430c-804e-3e29833d9f59 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:54.561969 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-fe9f7fd5-815f-430c-804e-3e29833d9f59 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:54.575401 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fe9f7fd5-815f-430c-804e-3e29833d9f59 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:54.575924 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fe9f7fd5-815f-430c-804e-3e29833d9f59 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:54.588391 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fe9f7fd5-815f-430c-804e-3e29833d9f59 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:54.589489 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fe9f7fd5-815f-430c-804e-3e29833d9f59 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:54.592668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fe9f7fd5-815f-430c-804e-3e29833d9f59 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:54.592668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fe9f7fd5-815f-430c-804e-3e29833d9f59 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:54.976292 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-fe9f7fd5-815f-430c-804e-3e29833d9f59 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:54.985243 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-fe9f7fd5-815f-430c-804e-3e29833d9f59 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.430236 Sep 26 18:03:54.992210 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 37/67] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:54 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:55.312485 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-81cfc016-123a-40c4-b789-fb969d074b44 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:55.313285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-81cfc016-123a-40c4-b789-fb969d074b44 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:55.321303 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-81cfc016-123a-40c4-b789-fb969d074b44 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:55.321961 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-81cfc016-123a-40c4-b789-fb969d074b44 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:55.322817 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-81cfc016-123a-40c4-b789-fb969d074b44 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:55.323885 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-81cfc016-123a-40c4-b789-fb969d074b44 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:55.324600 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-81cfc016-123a-40c4-b789-fb969d074b44 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:55.325185 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-81cfc016-123a-40c4-b789-fb969d074b44 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:55.580588 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1daa3e58-aafa-4612-b2e0-7316e48e5893 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:55.581191 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1daa3e58-aafa-4612-b2e0-7316e48e5893 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:55.587727 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1daa3e58-aafa-4612-b2e0-7316e48e5893 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:55.588640 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1daa3e58-aafa-4612-b2e0-7316e48e5893 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:55.589271 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1daa3e58-aafa-4612-b2e0-7316e48e5893 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:55.590580 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1daa3e58-aafa-4612-b2e0-7316e48e5893 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:55.591186 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1daa3e58-aafa-4612-b2e0-7316e48e5893 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:55.591989 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1daa3e58-aafa-4612-b2e0-7316e48e5893 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:55.664980 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-81cfc016-123a-40c4-b789-fb969d074b44 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:55.673076 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-81cfc016-123a-40c4-b789-fb969d074b44 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.364265 Sep 26 18:03:55.673867 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 31/68] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:55 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:55.830463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1daa3e58-aafa-4612-b2e0-7316e48e5893 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:55.845748 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1daa3e58-aafa-4612-b2e0-7316e48e5893 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.270283 Sep 26 18:03:55.847365 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 38/69] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:55 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:56.014032 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7e35f828-1dd7-4d7d-8b25-49eb7b508431 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:56.014635 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7e35f828-1dd7-4d7d-8b25-49eb7b508431 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:56.020896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e35f828-1dd7-4d7d-8b25-49eb7b508431 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:56.022266 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e35f828-1dd7-4d7d-8b25-49eb7b508431 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:56.022971 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e35f828-1dd7-4d7d-8b25-49eb7b508431 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:56.023715 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e35f828-1dd7-4d7d-8b25-49eb7b508431 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:56.024175 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e35f828-1dd7-4d7d-8b25-49eb7b508431 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:56.024608 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e35f828-1dd7-4d7d-8b25-49eb7b508431 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:56.219426 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7e35f828-1dd7-4d7d-8b25-49eb7b508431 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:56.230883 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7e35f828-1dd7-4d7d-8b25-49eb7b508431 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.223474 Sep 26 18:03:56.232040 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 32/70] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:56 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:56.382371 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-18d50d85-cdc4-4051-a49b-5117d7fbc295 req-4cbb49c7-2f0e-4d12-be4b-702c273da268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "220b1da2-7651-436f-ab85-1d16ee3ecea0", "tag": "9ef108b0-8394-4e0e-8563-6390415fb8c4"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:03:56.392463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-18d50d85-cdc4-4051-a49b-5117d7fbc295 req-4cbb49c7-2f0e-4d12-be4b-702c273da268 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:56.392946 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-18d50d85-cdc4-4051-a49b-5117d7fbc295 req-4cbb49c7-2f0e-4d12-be4b-702c273da268 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:56.393375 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-18d50d85-cdc4-4051-a49b-5117d7fbc295 req-4cbb49c7-2f0e-4d12-be4b-702c273da268 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:56.405676 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-18d50d85-cdc4-4051-a49b-5117d7fbc295 req-4cbb49c7-2f0e-4d12-be4b-702c273da268 service nova] Creating event network-changed:9ef108b0-8394-4e0e-8563-6390415fb8c4 for instance 220b1da2-7651-436f-ab85-1d16ee3ecea0 on hv-cinder-85931 Sep 26 18:03:56.414162 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-18d50d85-cdc4-4051-a49b-5117d7fbc295 req-4cbb49c7-2f0e-4d12-be4b-702c273da268 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036278 Sep 26 18:03:56.414777 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 39/71] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:03:56.708882 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9aa066f3-8d21-4b36-b0c3-61b9d893eb27 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:56.708882 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9aa066f3-8d21-4b36-b0c3-61b9d893eb27 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:56.710975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9aa066f3-8d21-4b36-b0c3-61b9d893eb27 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:56.711590 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9aa066f3-8d21-4b36-b0c3-61b9d893eb27 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:56.712174 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9aa066f3-8d21-4b36-b0c3-61b9d893eb27 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:56.713033 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9aa066f3-8d21-4b36-b0c3-61b9d893eb27 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:56.713582 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9aa066f3-8d21-4b36-b0c3-61b9d893eb27 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:56.714095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9aa066f3-8d21-4b36-b0c3-61b9d893eb27 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:56.877940 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2567a9e2-63f5-4b32-bcf4-8198aa9f82eb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:56.878647 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2567a9e2-63f5-4b32-bcf4-8198aa9f82eb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:56.887168 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2567a9e2-63f5-4b32-bcf4-8198aa9f82eb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:56.887677 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2567a9e2-63f5-4b32-bcf4-8198aa9f82eb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:56.888218 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2567a9e2-63f5-4b32-bcf4-8198aa9f82eb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:56.888959 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2567a9e2-63f5-4b32-bcf4-8198aa9f82eb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:56.889417 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2567a9e2-63f5-4b32-bcf4-8198aa9f82eb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:56.891194 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2567a9e2-63f5-4b32-bcf4-8198aa9f82eb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:57.151833 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9aa066f3-8d21-4b36-b0c3-61b9d893eb27 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:57.175949 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2567a9e2-63f5-4b32-bcf4-8198aa9f82eb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:57.183850 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9aa066f3-8d21-4b36-b0c3-61b9d893eb27 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.487118 Sep 26 18:03:57.186320 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 33/72] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:56 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:57.188027 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2567a9e2-63f5-4b32-bcf4-8198aa9f82eb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.314496 Sep 26 18:03:57.202436 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 40/73] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:56 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:03:57.255211 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-562d1fa2-e010-41eb-9598-e9bdd8478221 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:57.256214 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-562d1fa2-e010-41eb-9598-e9bdd8478221 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:57.263270 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-562d1fa2-e010-41eb-9598-e9bdd8478221 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:57.263803 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-562d1fa2-e010-41eb-9598-e9bdd8478221 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:57.264469 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-562d1fa2-e010-41eb-9598-e9bdd8478221 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:57.265344 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-562d1fa2-e010-41eb-9598-e9bdd8478221 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:57.265808 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-562d1fa2-e010-41eb-9598-e9bdd8478221 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:57.266244 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-562d1fa2-e010-41eb-9598-e9bdd8478221 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:57.467026 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-562d1fa2-e010-41eb-9598-e9bdd8478221 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:57.477926 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-562d1fa2-e010-41eb-9598-e9bdd8478221 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.227182 Sep 26 18:03:57.478845 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 34/74] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:57 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:58.220274 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4ef542b8-7d6a-4686-95ac-3fdfeb89cf0a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:58.222635 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d7499841-5f27-41a1-a3d5-a9d568ca4178 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:58.223338 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d7499841-5f27-41a1-a3d5-a9d568ca4178 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:58.226860 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4ef542b8-7d6a-4686-95ac-3fdfeb89cf0a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:58.236794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d7499841-5f27-41a1-a3d5-a9d568ca4178 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:58.237560 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ef542b8-7d6a-4686-95ac-3fdfeb89cf0a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:58.237711 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d7499841-5f27-41a1-a3d5-a9d568ca4178 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:58.238055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ef542b8-7d6a-4686-95ac-3fdfeb89cf0a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:58.238164 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d7499841-5f27-41a1-a3d5-a9d568ca4178 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:58.238490 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ef542b8-7d6a-4686-95ac-3fdfeb89cf0a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:58.239195 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ef542b8-7d6a-4686-95ac-3fdfeb89cf0a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:58.239301 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d7499841-5f27-41a1-a3d5-a9d568ca4178 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:58.239757 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ef542b8-7d6a-4686-95ac-3fdfeb89cf0a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:58.239953 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d7499841-5f27-41a1-a3d5-a9d568ca4178 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:58.240252 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ef542b8-7d6a-4686-95ac-3fdfeb89cf0a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:58.240614 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d7499841-5f27-41a1-a3d5-a9d568ca4178 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:58.451144 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-4ef542b8-7d6a-4686-95ac-3fdfeb89cf0a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:58.458146 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d7499841-5f27-41a1-a3d5-a9d568ca4178 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:58.460522 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4ef542b8-7d6a-4686-95ac-3fdfeb89cf0a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.246138 Sep 26 18:03:58.463697 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 41/75] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:58 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:58.485707 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d7499841-5f27-41a1-a3d5-a9d568ca4178 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.258065 Sep 26 18:03:58.485707 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 35/76] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:58 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:58.500977 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c1e1caa8-530e-4005-a924-4494ef09ab8b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:58.501878 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c1e1caa8-530e-4005-a924-4494ef09ab8b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:58.512809 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1e1caa8-530e-4005-a924-4494ef09ab8b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:58.513313 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1e1caa8-530e-4005-a924-4494ef09ab8b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:58.513748 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1e1caa8-530e-4005-a924-4494ef09ab8b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:58.514577 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1e1caa8-530e-4005-a924-4494ef09ab8b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:58.514903 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1e1caa8-530e-4005-a924-4494ef09ab8b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:58.515327 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1e1caa8-530e-4005-a924-4494ef09ab8b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:58.665396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c1e1caa8-530e-4005-a924-4494ef09ab8b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:58.673550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c1e1caa8-530e-4005-a924-4494ef09ab8b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.176438 Sep 26 18:03:58.674137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 42/77] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:58 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:59.493776 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e61aacee-94de-4353-b86e-8e7789c5f996 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:59.494440 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e61aacee-94de-4353-b86e-8e7789c5f996 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:59.513419 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e61aacee-94de-4353-b86e-8e7789c5f996 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:59.513419 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e61aacee-94de-4353-b86e-8e7789c5f996 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:59.513419 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e61aacee-94de-4353-b86e-8e7789c5f996 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:59.513419 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e61aacee-94de-4353-b86e-8e7789c5f996 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:59.513702 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e61aacee-94de-4353-b86e-8e7789c5f996 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:59.513702 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e61aacee-94de-4353-b86e-8e7789c5f996 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:59.513828 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e944ab7d-ebd0-45c3-bef7-7468c1b542cc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:59.513828 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e944ab7d-ebd0-45c3-bef7-7468c1b542cc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:59.513828 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e944ab7d-ebd0-45c3-bef7-7468c1b542cc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:59.513828 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e944ab7d-ebd0-45c3-bef7-7468c1b542cc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:59.514412 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e944ab7d-ebd0-45c3-bef7-7468c1b542cc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:59.514412 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e944ab7d-ebd0-45c3-bef7-7468c1b542cc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:59.514412 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e944ab7d-ebd0-45c3-bef7-7468c1b542cc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:59.514412 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e944ab7d-ebd0-45c3-bef7-7468c1b542cc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:59.700123 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e944ab7d-ebd0-45c3-bef7-7468c1b542cc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:59.707842 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e944ab7d-ebd0-45c3-bef7-7468c1b542cc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.208248 Sep 26 18:03:59.708418 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 43/78] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:59 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:59.713756 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e61aacee-94de-4353-b86e-8e7789c5f996 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:59.714303 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-61ac6073-3e91-4a8b-bd68-3425057e759f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:03:59.714941 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-61ac6073-3e91-4a8b-bd68-3425057e759f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:03:59.720898 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-61ac6073-3e91-4a8b-bd68-3425057e759f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:59.721386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-61ac6073-3e91-4a8b-bd68-3425057e759f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:59.721787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e61aacee-94de-4353-b86e-8e7789c5f996 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.232388 Sep 26 18:03:59.721919 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-61ac6073-3e91-4a8b-bd68-3425057e759f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:59.722487 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 36/79] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:59 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:03:59.722605 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-61ac6073-3e91-4a8b-bd68-3425057e759f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:03:59.723053 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-61ac6073-3e91-4a8b-bd68-3425057e759f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:03:59.723480 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-61ac6073-3e91-4a8b-bd68-3425057e759f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:03:59.857727 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-61ac6073-3e91-4a8b-bd68-3425057e759f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:03:59.865736 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-61ac6073-3e91-4a8b-bd68-3425057e759f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.155264 Sep 26 18:03:59.866759 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 44/80] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:03:59 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:00.733558 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7f353cd1-149b-48e4-b59f-8af79bb70b7c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:00.734261 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7f353cd1-149b-48e4-b59f-8af79bb70b7c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:00.741019 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7f353cd1-149b-48e4-b59f-8af79bb70b7c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:00.741620 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7f353cd1-149b-48e4-b59f-8af79bb70b7c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:00.742198 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7f353cd1-149b-48e4-b59f-8af79bb70b7c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:00.743023 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7f353cd1-149b-48e4-b59f-8af79bb70b7c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:00.743557 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7f353cd1-149b-48e4-b59f-8af79bb70b7c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:00.744207 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7f353cd1-149b-48e4-b59f-8af79bb70b7c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:00.747323 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8559abc4-4477-4656-b41b-6daeeee5d6b0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:00.748066 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-8559abc4-4477-4656-b41b-6daeeee5d6b0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:00.754330 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8559abc4-4477-4656-b41b-6daeeee5d6b0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:00.754900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8559abc4-4477-4656-b41b-6daeeee5d6b0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:00.755406 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8559abc4-4477-4656-b41b-6daeeee5d6b0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:00.756508 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8559abc4-4477-4656-b41b-6daeeee5d6b0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:00.757140 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8559abc4-4477-4656-b41b-6daeeee5d6b0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:00.757785 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8559abc4-4477-4656-b41b-6daeeee5d6b0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:01.197424 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7f353cd1-149b-48e4-b59f-8af79bb70b7c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:01.205374 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8559abc4-4477-4656-b41b-6daeeee5d6b0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:01.207107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7f353cd1-149b-48e4-b59f-8af79bb70b7c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.477676 Sep 26 18:04:01.220974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 37/81] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:00 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:01.233449 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8559abc4-4477-4656-b41b-6daeeee5d6b0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.489661 Sep 26 18:04:01.233870 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 45/82] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:00 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:01.241121 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c6de0664-e770-4c33-8db6-749b32f495f1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:01.241741 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c6de0664-e770-4c33-8db6-749b32f495f1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:01.249944 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c6de0664-e770-4c33-8db6-749b32f495f1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:01.250721 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c6de0664-e770-4c33-8db6-749b32f495f1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:01.251163 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c6de0664-e770-4c33-8db6-749b32f495f1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:01.251904 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c6de0664-e770-4c33-8db6-749b32f495f1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:01.252519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c6de0664-e770-4c33-8db6-749b32f495f1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:01.253108 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c6de0664-e770-4c33-8db6-749b32f495f1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:01.468303 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c6de0664-e770-4c33-8db6-749b32f495f1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:01.477399 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c6de0664-e770-4c33-8db6-749b32f495f1 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.255002 Sep 26 18:04:01.484933 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 38/83] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:01 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:02.122823 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-9f415671-b7f6-4165-a9e1-b36a636191ce req-187b47ae-b938-4544-beea-c078fe84223a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9682673d-b9ac-49a7-9f72-eef56dcbac73", "tag": "88d9ddc3-ae2c-428a-b7ad-f212435e977b"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:02.140686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-9f415671-b7f6-4165-a9e1-b36a636191ce req-187b47ae-b938-4544-beea-c078fe84223a service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:02.141717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-9f415671-b7f6-4165-a9e1-b36a636191ce req-187b47ae-b938-4544-beea-c078fe84223a service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:02.142148 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-9f415671-b7f6-4165-a9e1-b36a636191ce req-187b47ae-b938-4544-beea-c078fe84223a service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:02.155586 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-9f415671-b7f6-4165-a9e1-b36a636191ce req-187b47ae-b938-4544-beea-c078fe84223a service nova] Creating event network-changed:88d9ddc3-ae2c-428a-b7ad-f212435e977b for instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 on hv-cinder-85931 Sep 26 18:04:02.161359 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-9f415671-b7f6-4165-a9e1-b36a636191ce req-187b47ae-b938-4544-beea-c078fe84223a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052277 Sep 26 18:04:02.162725 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 46/84] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:02.236125 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ea200d34-0766-43c7-bb02-2e81d8bae9d4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:02.237387 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ea200d34-0766-43c7-bb02-2e81d8bae9d4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:02.245430 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ea200d34-0766-43c7-bb02-2e81d8bae9d4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:02.246226 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ea200d34-0766-43c7-bb02-2e81d8bae9d4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:02.246839 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ea200d34-0766-43c7-bb02-2e81d8bae9d4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:02.247945 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ea200d34-0766-43c7-bb02-2e81d8bae9d4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:02.250412 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ea200d34-0766-43c7-bb02-2e81d8bae9d4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:02.250412 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ea200d34-0766-43c7-bb02-2e81d8bae9d4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:02.268669 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d7e7bd9c-d94d-4c2c-a6ae-4e77f780a578 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:02.273475 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d7e7bd9c-d94d-4c2c-a6ae-4e77f780a578 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:02.293322 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d7e7bd9c-d94d-4c2c-a6ae-4e77f780a578 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:02.301558 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d7e7bd9c-d94d-4c2c-a6ae-4e77f780a578 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:02.302270 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d7e7bd9c-d94d-4c2c-a6ae-4e77f780a578 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:02.304841 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d7e7bd9c-d94d-4c2c-a6ae-4e77f780a578 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:02.304841 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d7e7bd9c-d94d-4c2c-a6ae-4e77f780a578 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:02.304841 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d7e7bd9c-d94d-4c2c-a6ae-4e77f780a578 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:02.377851 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=2 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:03.069441 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d7e7bd9c-d94d-4c2c-a6ae-4e77f780a578 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:03.094884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d7e7bd9c-d94d-4c2c-a6ae-4e77f780a578 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.837574 Sep 26 18:04:03.099754 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 47/85] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:02 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:03.108825 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-0ac01e2b-6c73-4036-9305-30e2b2903489 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:03.110245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-0ac01e2b-6c73-4036-9305-30e2b2903489 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:03.125285 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0ac01e2b-6c73-4036-9305-30e2b2903489 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:03.127884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0ac01e2b-6c73-4036-9305-30e2b2903489 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:03.128601 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0ac01e2b-6c73-4036-9305-30e2b2903489 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:03.129500 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0ac01e2b-6c73-4036-9305-30e2b2903489 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:03.129873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ea200d34-0766-43c7-bb02-2e81d8bae9d4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:03.130322 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0ac01e2b-6c73-4036-9305-30e2b2903489 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:03.132352 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0ac01e2b-6c73-4036-9305-30e2b2903489 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:03.146526 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ea200d34-0766-43c7-bb02-2e81d8bae9d4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.906319 Sep 26 18:04:03.146526 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 39/86] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:02 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:03.178815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=100 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:03.360943 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-0ac01e2b-6c73-4036-9305-30e2b2903489 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:03.369432 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-0ac01e2b-6c73-4036-9305-30e2b2903489 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.267493 Sep 26 18:04:03.370259 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 48/87] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:03 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:04.124655 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-91ddf404-f0ec-4ac2-8abd-c8f7217ffcc5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:04.125816 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-91ddf404-f0ec-4ac2-8abd-c8f7217ffcc5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:04.127823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:04.132535 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-91ddf404-f0ec-4ac2-8abd-c8f7217ffcc5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:04.133027 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-91ddf404-f0ec-4ac2-8abd-c8f7217ffcc5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:04.133464 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-91ddf404-f0ec-4ac2-8abd-c8f7217ffcc5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:04.134168 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-91ddf404-f0ec-4ac2-8abd-c8f7217ffcc5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:04.134658 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-91ddf404-f0ec-4ac2-8abd-c8f7217ffcc5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:04.135355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-91ddf404-f0ec-4ac2-8abd-c8f7217ffcc5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:04.178938 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e26071c4-1d1f-4860-8df8-a9b5cc121fc1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:04.180251 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e26071c4-1d1f-4860-8df8-a9b5cc121fc1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:04.186719 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e26071c4-1d1f-4860-8df8-a9b5cc121fc1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:04.187397 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e26071c4-1d1f-4860-8df8-a9b5cc121fc1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:04.188036 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e26071c4-1d1f-4860-8df8-a9b5cc121fc1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:04.188875 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e26071c4-1d1f-4860-8df8-a9b5cc121fc1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:04.189706 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e26071c4-1d1f-4860-8df8-a9b5cc121fc1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:04.190276 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e26071c4-1d1f-4860-8df8-a9b5cc121fc1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:04.388162 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-91ddf404-f0ec-4ac2-8abd-c8f7217ffcc5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:04.397668 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-91ddf404-f0ec-4ac2-8abd-c8f7217ffcc5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.276631 Sep 26 18:04:04.398262 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 40/88] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:04 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:04.408370 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-2167a3c6-60ef-46e6-a544-985f30a23532 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:04.408990 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-2167a3c6-60ef-46e6-a544-985f30a23532 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:04.421926 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2167a3c6-60ef-46e6-a544-985f30a23532 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:04.422094 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e26071c4-1d1f-4860-8df8-a9b5cc121fc1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:04.422414 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2167a3c6-60ef-46e6-a544-985f30a23532 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:04.424660 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2167a3c6-60ef-46e6-a544-985f30a23532 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:04.425537 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2167a3c6-60ef-46e6-a544-985f30a23532 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:04.426152 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2167a3c6-60ef-46e6-a544-985f30a23532 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:04.426725 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2167a3c6-60ef-46e6-a544-985f30a23532 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:04.433827 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e26071c4-1d1f-4860-8df8-a9b5cc121fc1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.259786 Sep 26 18:04:04.444346 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 49/89] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:04 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:04.586162 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-2167a3c6-60ef-46e6-a544-985f30a23532 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:04.593878 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-2167a3c6-60ef-46e6-a544-985f30a23532 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.194655 Sep 26 18:04:04.594448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 41/90] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:04 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:05.426108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-42276a29-3013-4181-97af-2993d6e2708f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:05.426874 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-42276a29-3013-4181-97af-2993d6e2708f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:05.434712 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-42276a29-3013-4181-97af-2993d6e2708f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:05.435194 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-42276a29-3013-4181-97af-2993d6e2708f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:05.435629 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-42276a29-3013-4181-97af-2993d6e2708f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:05.436349 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-42276a29-3013-4181-97af-2993d6e2708f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:05.436806 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-42276a29-3013-4181-97af-2993d6e2708f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:05.437228 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-42276a29-3013-4181-97af-2993d6e2708f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:05.469921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d2528a6f-4d36-4a78-8546-fa046a369c6e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:05.470643 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d2528a6f-4d36-4a78-8546-fa046a369c6e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:05.477293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d2528a6f-4d36-4a78-8546-fa046a369c6e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:05.477786 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d2528a6f-4d36-4a78-8546-fa046a369c6e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:05.478216 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d2528a6f-4d36-4a78-8546-fa046a369c6e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:05.479081 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d2528a6f-4d36-4a78-8546-fa046a369c6e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:05.479716 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d2528a6f-4d36-4a78-8546-fa046a369c6e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:05.480138 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d2528a6f-4d36-4a78-8546-fa046a369c6e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:05.503996 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=100 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:05.639779 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-42276a29-3013-4181-97af-2993d6e2708f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:05.651142 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-42276a29-3013-4181-97af-2993d6e2708f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.230403 Sep 26 18:04:05.651749 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 50/91] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:05 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:05.656760 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e23bb7c4-993d-438d-9436-bb2377b11c32 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:05.657362 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e23bb7c4-993d-438d-9436-bb2377b11c32 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:05.666944 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e23bb7c4-993d-438d-9436-bb2377b11c32 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:05.667428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e23bb7c4-993d-438d-9436-bb2377b11c32 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:05.667952 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e23bb7c4-993d-438d-9436-bb2377b11c32 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:05.668690 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e23bb7c4-993d-438d-9436-bb2377b11c32 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:05.669156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e23bb7c4-993d-438d-9436-bb2377b11c32 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:05.669582 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e23bb7c4-993d-438d-9436-bb2377b11c32 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:05.674993 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d2528a6f-4d36-4a78-8546-fa046a369c6e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:05.684363 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d2528a6f-4d36-4a78-8546-fa046a369c6e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.218390 Sep 26 18:04:05.685200 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 42/92] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:05 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:05.822845 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e23bb7c4-993d-438d-9436-bb2377b11c32 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:05.837694 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e23bb7c4-993d-438d-9436-bb2377b11c32 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.184739 Sep 26 18:04:05.838737 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 51/93] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:05 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:06.680588 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-770d52d4-e24e-4d57-9254-e99750ab5a15 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:06.681376 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-770d52d4-e24e-4d57-9254-e99750ab5a15 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:06.687982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-770d52d4-e24e-4d57-9254-e99750ab5a15 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:06.688479 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-770d52d4-e24e-4d57-9254-e99750ab5a15 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:06.688916 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-770d52d4-e24e-4d57-9254-e99750ab5a15 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:06.689627 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-770d52d4-e24e-4d57-9254-e99750ab5a15 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:06.690090 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-770d52d4-e24e-4d57-9254-e99750ab5a15 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:06.690513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-770d52d4-e24e-4d57-9254-e99750ab5a15 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:06.720897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-0d3a508d-8d23-4c68-98d2-0cc6d09e08e0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:06.720897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-0d3a508d-8d23-4c68-98d2-0cc6d09e08e0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:06.725855 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0d3a508d-8d23-4c68-98d2-0cc6d09e08e0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:06.726682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0d3a508d-8d23-4c68-98d2-0cc6d09e08e0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:06.727603 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0d3a508d-8d23-4c68-98d2-0cc6d09e08e0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:06.729134 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0d3a508d-8d23-4c68-98d2-0cc6d09e08e0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:06.730543 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0d3a508d-8d23-4c68-98d2-0cc6d09e08e0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:06.731551 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0d3a508d-8d23-4c68-98d2-0cc6d09e08e0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:06.996517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-770d52d4-e24e-4d57-9254-e99750ab5a15 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:06.996517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-770d52d4-e24e-4d57-9254-e99750ab5a15 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.231567 Sep 26 18:04:06.996517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 43/94] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:06 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:06.996517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-75dfe3da-f68a-4813-8209-ffbfcc882ba4 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:06.998196 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-75dfe3da-f68a-4813-8209-ffbfcc882ba4 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:06.998196 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75dfe3da-f68a-4813-8209-ffbfcc882ba4 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:06.998196 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75dfe3da-f68a-4813-8209-ffbfcc882ba4 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:06.998196 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75dfe3da-f68a-4813-8209-ffbfcc882ba4 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:06.998489 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75dfe3da-f68a-4813-8209-ffbfcc882ba4 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:06.998489 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75dfe3da-f68a-4813-8209-ffbfcc882ba4 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:06.998489 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75dfe3da-f68a-4813-8209-ffbfcc882ba4 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:06.998671 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-0d3a508d-8d23-4c68-98d2-0cc6d09e08e0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:06.998671 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-0d3a508d-8d23-4c68-98d2-0cc6d09e08e0 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.241782 Sep 26 18:04:06.998671 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 52/95] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:06 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:07.071117 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-75dfe3da-f68a-4813-8209-ffbfcc882ba4 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:07.078928 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-75dfe3da-f68a-4813-8209-ffbfcc882ba4 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.169357 Sep 26 18:04:07.079485 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 44/96] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:06 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:07.993737 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-75af7006-57a5-4b6f-b0d2-1aab13ec9cac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:07.995109 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-75af7006-57a5-4b6f-b0d2-1aab13ec9cac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:07.995602 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5727d30d-8a74-4815-b635-10ac4eca34ea tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:07.996727 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-5727d30d-8a74-4815-b635-10ac4eca34ea tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:08.002336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75af7006-57a5-4b6f-b0d2-1aab13ec9cac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:08.003192 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75af7006-57a5-4b6f-b0d2-1aab13ec9cac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:08.003537 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5727d30d-8a74-4815-b635-10ac4eca34ea tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:08.004048 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75af7006-57a5-4b6f-b0d2-1aab13ec9cac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:08.004227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5727d30d-8a74-4815-b635-10ac4eca34ea tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:08.004583 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5727d30d-8a74-4815-b635-10ac4eca34ea tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:08.005132 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75af7006-57a5-4b6f-b0d2-1aab13ec9cac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:08.005870 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5727d30d-8a74-4815-b635-10ac4eca34ea tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:08.006396 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5727d30d-8a74-4815-b635-10ac4eca34ea tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:08.006584 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75af7006-57a5-4b6f-b0d2-1aab13ec9cac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:08.006990 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5727d30d-8a74-4815-b635-10ac4eca34ea tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:08.007122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75af7006-57a5-4b6f-b0d2-1aab13ec9cac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:08.222107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5727d30d-8a74-4815-b635-10ac4eca34ea tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:08.237436 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-75af7006-57a5-4b6f-b0d2-1aab13ec9cac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:08.237887 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5727d30d-8a74-4815-b635-10ac4eca34ea tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.245876 Sep 26 18:04:08.240124 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 45/97] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:07 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:08.246495 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-75af7006-57a5-4b6f-b0d2-1aab13ec9cac tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.257976 Sep 26 18:04:08.247489 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ad46601a-8853-40b9-ac0b-82a239aba913 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:08.247603 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 53/98] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:07 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:08.247969 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ad46601a-8853-40b9-ac0b-82a239aba913 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:08.254194 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad46601a-8853-40b9-ac0b-82a239aba913 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:08.254747 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad46601a-8853-40b9-ac0b-82a239aba913 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:08.255184 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad46601a-8853-40b9-ac0b-82a239aba913 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:08.256531 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad46601a-8853-40b9-ac0b-82a239aba913 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:08.256949 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad46601a-8853-40b9-ac0b-82a239aba913 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:08.257377 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad46601a-8853-40b9-ac0b-82a239aba913 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:08.397588 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ad46601a-8853-40b9-ac0b-82a239aba913 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:08.405049 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ad46601a-8853-40b9-ac0b-82a239aba913 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.163313 Sep 26 18:04:08.405614 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 46/99] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:08 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:09.276069 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c83a4822-9cbc-490b-83d4-abd5833551dc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:09.276069 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c83a4822-9cbc-490b-83d4-abd5833551dc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:09.276965 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-312fbbe4-6b91-4f37-ba3e-8c827f75af47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:09.276965 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-312fbbe4-6b91-4f37-ba3e-8c827f75af47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:09.277803 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c83a4822-9cbc-490b-83d4-abd5833551dc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:09.277803 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c83a4822-9cbc-490b-83d4-abd5833551dc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:09.277803 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c83a4822-9cbc-490b-83d4-abd5833551dc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:09.277803 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c83a4822-9cbc-490b-83d4-abd5833551dc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:09.278363 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c83a4822-9cbc-490b-83d4-abd5833551dc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:09.278363 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c83a4822-9cbc-490b-83d4-abd5833551dc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:09.295437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-312fbbe4-6b91-4f37-ba3e-8c827f75af47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:09.296629 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-312fbbe4-6b91-4f37-ba3e-8c827f75af47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:09.297624 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-312fbbe4-6b91-4f37-ba3e-8c827f75af47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:09.298988 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-312fbbe4-6b91-4f37-ba3e-8c827f75af47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:09.299789 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-312fbbe4-6b91-4f37-ba3e-8c827f75af47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:09.300362 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-312fbbe4-6b91-4f37-ba3e-8c827f75af47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:09.524103 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c83a4822-9cbc-490b-83d4-abd5833551dc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:09.527068 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-312fbbe4-6b91-4f37-ba3e-8c827f75af47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:09.532519 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c83a4822-9cbc-490b-83d4-abd5833551dc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.267646 Sep 26 18:04:09.533097 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 54/100] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:09 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:09.535958 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-312fbbe4-6b91-4f37-ba3e-8c827f75af47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.266304 Sep 26 18:04:09.537088 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 47/101] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:09 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:09.538642 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-fb907299-bce5-4ce7-bdd9-c12786e51c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:09.539257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-fb907299-bce5-4ce7-bdd9-c12786e51c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:09.545410 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fb907299-bce5-4ce7-bdd9-c12786e51c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:09.546097 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fb907299-bce5-4ce7-bdd9-c12786e51c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:09.546620 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fb907299-bce5-4ce7-bdd9-c12786e51c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:09.547325 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fb907299-bce5-4ce7-bdd9-c12786e51c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:09.547831 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fb907299-bce5-4ce7-bdd9-c12786e51c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:09.548261 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fb907299-bce5-4ce7-bdd9-c12786e51c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:09.686158 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-fb907299-bce5-4ce7-bdd9-c12786e51c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:09.696653 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-fb907299-bce5-4ce7-bdd9-c12786e51c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.160388 Sep 26 18:04:09.696653 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 55/102] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:09 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:10.355221 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-b9260261-caf0-4e30-b571-a7b6683cdc3d req-c66a0014-4c93-4c61-80cf-0d60ed61242c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92dd8f8-d04b-4fb0-804a-8842bd4c60c9", "name": "network-vif-plugged", "status": "completed", "tag": "88eb2714-0a5c-49b3-aebb-0b129916ee37"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:10.367881 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-b9260261-caf0-4e30-b571-a7b6683cdc3d req-c66a0014-4c93-4c61-80cf-0d60ed61242c service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:10.371571 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-b9260261-caf0-4e30-b571-a7b6683cdc3d req-c66a0014-4c93-4c61-80cf-0d60ed61242c service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:10.371571 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-b9260261-caf0-4e30-b571-a7b6683cdc3d req-c66a0014-4c93-4c61-80cf-0d60ed61242c service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:10.381841 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-b9260261-caf0-4e30-b571-a7b6683cdc3d req-c66a0014-4c93-4c61-80cf-0d60ed61242c service nova] Creating event network-vif-plugged:88eb2714-0a5c-49b3-aebb-0b129916ee37 for instance f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 on hv-cinder-85931 Sep 26 18:04:10.387864 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-b9260261-caf0-4e30-b571-a7b6683cdc3d req-c66a0014-4c93-4c61-80cf-0d60ed61242c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114058 Sep 26 18:04:10.389234 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 48/103] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:10.560372 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-7a7a1dc0-1db6-409e-b6a7-29b15d4a6b24 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:10.561466 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-7a7a1dc0-1db6-409e-b6a7-29b15d4a6b24 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:10.562622 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-64e9b168-d227-4828-b3b1-15b165b08f74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:10.563397 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-64e9b168-d227-4828-b3b1-15b165b08f74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:10.572236 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64e9b168-d227-4828-b3b1-15b165b08f74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:10.572493 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a7a1dc0-1db6-409e-b6a7-29b15d4a6b24 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:10.573067 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64e9b168-d227-4828-b3b1-15b165b08f74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:10.574246 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a7a1dc0-1db6-409e-b6a7-29b15d4a6b24 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:10.574440 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64e9b168-d227-4828-b3b1-15b165b08f74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:10.574608 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a7a1dc0-1db6-409e-b6a7-29b15d4a6b24 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:10.575128 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64e9b168-d227-4828-b3b1-15b165b08f74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:10.575326 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a7a1dc0-1db6-409e-b6a7-29b15d4a6b24 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:10.576143 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a7a1dc0-1db6-409e-b6a7-29b15d4a6b24 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:10.576771 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64e9b168-d227-4828-b3b1-15b165b08f74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:10.576930 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a7a1dc0-1db6-409e-b6a7-29b15d4a6b24 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:10.577412 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64e9b168-d227-4828-b3b1-15b165b08f74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:10.795144 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-64e9b168-d227-4828-b3b1-15b165b08f74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:10.805847 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-64e9b168-d227-4828-b3b1-15b165b08f74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.248271 Sep 26 18:04:10.806777 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 49/104] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:10 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:10.813484 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-248ca7a2-2c03-4151-879e-40a3e1d76336 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:10.830113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-248ca7a2-2c03-4151-879e-40a3e1d76336 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:10.830113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-248ca7a2-2c03-4151-879e-40a3e1d76336 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:10.830113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-248ca7a2-2c03-4151-879e-40a3e1d76336 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:10.830113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-248ca7a2-2c03-4151-879e-40a3e1d76336 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:10.830680 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-248ca7a2-2c03-4151-879e-40a3e1d76336 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:10.830680 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-248ca7a2-2c03-4151-879e-40a3e1d76336 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:10.830680 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-248ca7a2-2c03-4151-879e-40a3e1d76336 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:10.858241 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-7a7a1dc0-1db6-409e-b6a7-29b15d4a6b24 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:10.868132 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-7a7a1dc0-1db6-409e-b6a7-29b15d4a6b24 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.315216 Sep 26 18:04:10.868717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 56/105] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:10 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:11.013640 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-248ca7a2-2c03-4151-879e-40a3e1d76336 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:11.024750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-248ca7a2-2c03-4151-879e-40a3e1d76336 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.212952 Sep 26 18:04:11.024750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 50/106] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:10 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:11.830425 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1c8c5f94-0fbc-4234-b027-c13a5679ad74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:11.831144 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1c8c5f94-0fbc-4234-b027-c13a5679ad74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:11.844579 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c8c5f94-0fbc-4234-b027-c13a5679ad74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:11.844579 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c8c5f94-0fbc-4234-b027-c13a5679ad74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:11.844972 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c8c5f94-0fbc-4234-b027-c13a5679ad74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:11.845770 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c8c5f94-0fbc-4234-b027-c13a5679ad74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:11.846287 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c8c5f94-0fbc-4234-b027-c13a5679ad74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:11.846800 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c8c5f94-0fbc-4234-b027-c13a5679ad74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:11.899575 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-deafc87e-e67d-499e-92ea-0186537d221f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:11.900589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-deafc87e-e67d-499e-92ea-0186537d221f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:11.906363 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-deafc87e-e67d-499e-92ea-0186537d221f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:11.907700 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-deafc87e-e67d-499e-92ea-0186537d221f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:11.907700 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-deafc87e-e67d-499e-92ea-0186537d221f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:11.908006 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-deafc87e-e67d-499e-92ea-0186537d221f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:11.908457 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-deafc87e-e67d-499e-92ea-0186537d221f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:11.908876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-deafc87e-e67d-499e-92ea-0186537d221f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:12.077652 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1c8c5f94-0fbc-4234-b027-c13a5679ad74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:12.085992 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1c8c5f94-0fbc-4234-b027-c13a5679ad74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.259303 Sep 26 18:04:12.086574 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 57/107] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:11 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:12.105884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4672b237-7520-4b38-bd0d-418acd9e4405 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:12.106618 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4672b237-7520-4b38-bd0d-418acd9e4405 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:12.112772 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4672b237-7520-4b38-bd0d-418acd9e4405 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:12.113337 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4672b237-7520-4b38-bd0d-418acd9e4405 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:12.113863 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4672b237-7520-4b38-bd0d-418acd9e4405 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:12.115304 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4672b237-7520-4b38-bd0d-418acd9e4405 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:12.116090 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4672b237-7520-4b38-bd0d-418acd9e4405 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:12.116628 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4672b237-7520-4b38-bd0d-418acd9e4405 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:12.136154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-deafc87e-e67d-499e-92ea-0186537d221f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:12.156717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-deafc87e-e67d-499e-92ea-0186537d221f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.261770 Sep 26 18:04:12.157311 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 51/108] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:11 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:12.265576 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-4672b237-7520-4b38-bd0d-418acd9e4405 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:12.276494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4672b237-7520-4b38-bd0d-418acd9e4405 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.178056 Sep 26 18:04:12.277063 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 58/109] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:12 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:13.110759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1b385f09-2d31-4ddf-a99a-90b9c56195b4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:13.111561 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1b385f09-2d31-4ddf-a99a-90b9c56195b4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:13.118254 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b385f09-2d31-4ddf-a99a-90b9c56195b4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:13.119167 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b385f09-2d31-4ddf-a99a-90b9c56195b4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:13.119872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b385f09-2d31-4ddf-a99a-90b9c56195b4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:13.120556 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b385f09-2d31-4ddf-a99a-90b9c56195b4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:13.121184 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b385f09-2d31-4ddf-a99a-90b9c56195b4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:13.121752 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b385f09-2d31-4ddf-a99a-90b9c56195b4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:13.181189 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f5cd2a31-4fe1-4740-a9d7-38892ca5f451 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:13.183598 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f5cd2a31-4fe1-4740-a9d7-38892ca5f451 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:13.188926 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5cd2a31-4fe1-4740-a9d7-38892ca5f451 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:13.189596 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5cd2a31-4fe1-4740-a9d7-38892ca5f451 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:13.190146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5cd2a31-4fe1-4740-a9d7-38892ca5f451 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:13.190970 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5cd2a31-4fe1-4740-a9d7-38892ca5f451 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:13.191959 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5cd2a31-4fe1-4740-a9d7-38892ca5f451 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:13.192843 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5cd2a31-4fe1-4740-a9d7-38892ca5f451 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:13.731837 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f5cd2a31-4fe1-4740-a9d7-38892ca5f451 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:13.746540 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f5cd2a31-4fe1-4740-a9d7-38892ca5f451 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.570073 Sep 26 18:04:13.747106 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 59/110] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:13 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:13.767611 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9337882c-1ec3-472b-a2a9-137b93b3f30c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:13.768452 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9337882c-1ec3-472b-a2a9-137b93b3f30c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:13.771768 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1b385f09-2d31-4ddf-a99a-90b9c56195b4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:13.777296 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9337882c-1ec3-472b-a2a9-137b93b3f30c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:13.777776 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9337882c-1ec3-472b-a2a9-137b93b3f30c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:13.778208 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9337882c-1ec3-472b-a2a9-137b93b3f30c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:13.778908 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9337882c-1ec3-472b-a2a9-137b93b3f30c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:13.779363 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9337882c-1ec3-472b-a2a9-137b93b3f30c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:13.779810 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9337882c-1ec3-472b-a2a9-137b93b3f30c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:13.781239 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1b385f09-2d31-4ddf-a99a-90b9c56195b4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.674863 Sep 26 18:04:13.782056 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 52/111] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:13 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:14.119264 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9337882c-1ec3-472b-a2a9-137b93b3f30c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:14.132256 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9337882c-1ec3-472b-a2a9-137b93b3f30c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.383305 Sep 26 18:04:14.133017 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 60/112] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:13 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:14.778053 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-292c468d-0b00-4ebe-a56b-5174724f17a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:14.778053 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-292c468d-0b00-4ebe-a56b-5174724f17a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:14.786428 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-292c468d-0b00-4ebe-a56b-5174724f17a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:14.787288 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-292c468d-0b00-4ebe-a56b-5174724f17a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:14.788159 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-292c468d-0b00-4ebe-a56b-5174724f17a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:14.789308 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-292c468d-0b00-4ebe-a56b-5174724f17a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:14.790113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-292c468d-0b00-4ebe-a56b-5174724f17a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:14.790869 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-292c468d-0b00-4ebe-a56b-5174724f17a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:14.818045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-328f0b50-d801-47b3-a9ae-d845a2405170 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:14.822429 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-328f0b50-d801-47b3-a9ae-d845a2405170 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:14.827511 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-328f0b50-d801-47b3-a9ae-d845a2405170 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:14.828216 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-328f0b50-d801-47b3-a9ae-d845a2405170 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:14.829032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-328f0b50-d801-47b3-a9ae-d845a2405170 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:14.829862 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-328f0b50-d801-47b3-a9ae-d845a2405170 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:14.830398 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-328f0b50-d801-47b3-a9ae-d845a2405170 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:14.831097 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-328f0b50-d801-47b3-a9ae-d845a2405170 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:14.997152 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-292c468d-0b00-4ebe-a56b-5174724f17a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:15.025940 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-292c468d-0b00-4ebe-a56b-5174724f17a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.239016 Sep 26 18:04:15.025940 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 53/113] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:14 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:15.066439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-328f0b50-d801-47b3-a9ae-d845a2405170 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:15.075318 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-328f0b50-d801-47b3-a9ae-d845a2405170 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.262846 Sep 26 18:04:15.076220 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 61/114] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:14 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:15.157054 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-43bba239-4a65-4317-86ed-aa97153ec108 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:15.157728 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-43bba239-4a65-4317-86ed-aa97153ec108 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:15.170637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-43bba239-4a65-4317-86ed-aa97153ec108 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:15.170637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-43bba239-4a65-4317-86ed-aa97153ec108 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:15.170637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-43bba239-4a65-4317-86ed-aa97153ec108 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:15.170637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-43bba239-4a65-4317-86ed-aa97153ec108 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:15.171743 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-43bba239-4a65-4317-86ed-aa97153ec108 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:15.172509 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-43bba239-4a65-4317-86ed-aa97153ec108 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:15.314925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-43bba239-4a65-4317-86ed-aa97153ec108 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:15.323312 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-43bba239-4a65-4317-86ed-aa97153ec108 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.170151 Sep 26 18:04:15.323925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 54/115] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:15 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:16.039769 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d3727a95-1cd0-4e24-85f6-8cf675cf85d4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:16.040368 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d3727a95-1cd0-4e24-85f6-8cf675cf85d4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:16.046445 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d3727a95-1cd0-4e24-85f6-8cf675cf85d4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:16.049942 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d3727a95-1cd0-4e24-85f6-8cf675cf85d4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:16.049942 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d3727a95-1cd0-4e24-85f6-8cf675cf85d4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:16.049942 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d3727a95-1cd0-4e24-85f6-8cf675cf85d4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:16.049942 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d3727a95-1cd0-4e24-85f6-8cf675cf85d4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:16.050482 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d3727a95-1cd0-4e24-85f6-8cf675cf85d4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:16.111749 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-afd404b4-cf27-4680-b8f3-4c31a3c56af7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:16.112264 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-afd404b4-cf27-4680-b8f3-4c31a3c56af7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:16.120276 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-afd404b4-cf27-4680-b8f3-4c31a3c56af7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:16.120875 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-afd404b4-cf27-4680-b8f3-4c31a3c56af7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:16.121429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-afd404b4-cf27-4680-b8f3-4c31a3c56af7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:16.122265 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-afd404b4-cf27-4680-b8f3-4c31a3c56af7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:16.122912 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-afd404b4-cf27-4680-b8f3-4c31a3c56af7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:16.123457 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-afd404b4-cf27-4680-b8f3-4c31a3c56af7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:16.223082 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d3727a95-1cd0-4e24-85f6-8cf675cf85d4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:16.242277 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d3727a95-1cd0-4e24-85f6-8cf675cf85d4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.202896 Sep 26 18:04:16.243304 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 62/116] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:16 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:16.352518 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-afd404b4-cf27-4680-b8f3-4c31a3c56af7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:16.354464 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b206311d-c744-46dd-8224-0dba648bfb79 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:16.355372 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b206311d-c744-46dd-8224-0dba648bfb79 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:16.361322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-afd404b4-cf27-4680-b8f3-4c31a3c56af7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.253664 Sep 26 18:04:16.362024 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 55/117] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:16 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:16.370519 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b206311d-c744-46dd-8224-0dba648bfb79 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:16.371399 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b206311d-c744-46dd-8224-0dba648bfb79 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:16.372210 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b206311d-c744-46dd-8224-0dba648bfb79 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:16.373692 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b206311d-c744-46dd-8224-0dba648bfb79 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:16.374782 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b206311d-c744-46dd-8224-0dba648bfb79 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:16.375550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b206311d-c744-46dd-8224-0dba648bfb79 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:16.526468 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b206311d-c744-46dd-8224-0dba648bfb79 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:16.537453 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b206311d-c744-46dd-8224-0dba648bfb79 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.189315 Sep 26 18:04:16.538414 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 63/118] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:16 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:17.072054 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-654444fb-8194-4c40-89aa-31048c92ef3f req-99a1f491-204c-4e14-9da0-2c34fbb10f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d3e0a96-a5c5-43b1-97d6-172536258bc4", "name": "network-vif-plugged", "status": "completed", "tag": "d0137809-e085-4d58-a7ea-c00ace0e5fb0"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:17.083804 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-654444fb-8194-4c40-89aa-31048c92ef3f req-99a1f491-204c-4e14-9da0-2c34fbb10f2f service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:17.084878 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-654444fb-8194-4c40-89aa-31048c92ef3f req-99a1f491-204c-4e14-9da0-2c34fbb10f2f service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:17.085666 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-654444fb-8194-4c40-89aa-31048c92ef3f req-99a1f491-204c-4e14-9da0-2c34fbb10f2f service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:17.101248 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-654444fb-8194-4c40-89aa-31048c92ef3f req-99a1f491-204c-4e14-9da0-2c34fbb10f2f service nova] Creating event network-vif-plugged:d0137809-e085-4d58-a7ea-c00ace0e5fb0 for instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 on hv-cinder-85931 Sep 26 18:04:17.107897 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-654444fb-8194-4c40-89aa-31048c92ef3f req-99a1f491-204c-4e14-9da0-2c34fbb10f2f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040413 Sep 26 18:04:17.108390 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 56/119] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:04:17.274203 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-bfe5840f-a60c-43fe-a250-57b3787856f7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:17.274203 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-bfe5840f-a60c-43fe-a250-57b3787856f7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:17.291810 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bfe5840f-a60c-43fe-a250-57b3787856f7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:17.293399 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bfe5840f-a60c-43fe-a250-57b3787856f7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:17.296386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bfe5840f-a60c-43fe-a250-57b3787856f7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:17.299375 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bfe5840f-a60c-43fe-a250-57b3787856f7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:17.302869 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bfe5840f-a60c-43fe-a250-57b3787856f7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:17.303958 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bfe5840f-a60c-43fe-a250-57b3787856f7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:17.408758 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-cc6b5d18-007b-41ac-9696-0c8d88d46fcd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:17.410192 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-cc6b5d18-007b-41ac-9696-0c8d88d46fcd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:17.424963 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cc6b5d18-007b-41ac-9696-0c8d88d46fcd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:17.443193 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cc6b5d18-007b-41ac-9696-0c8d88d46fcd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:17.443193 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cc6b5d18-007b-41ac-9696-0c8d88d46fcd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:17.443193 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cc6b5d18-007b-41ac-9696-0c8d88d46fcd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:17.448109 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cc6b5d18-007b-41ac-9696-0c8d88d46fcd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:17.448609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cc6b5d18-007b-41ac-9696-0c8d88d46fcd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:17.542443 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-bfe5840f-a60c-43fe-a250-57b3787856f7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:17.557246 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-bfe5840f-a60c-43fe-a250-57b3787856f7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.294378 Sep 26 18:04:17.559186 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 64/120] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:17 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:17.564681 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e77400d3-5795-4561-ae77-a019b089d846 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:17.565415 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e77400d3-5795-4561-ae77-a019b089d846 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:17.572419 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e77400d3-5795-4561-ae77-a019b089d846 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:17.573237 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e77400d3-5795-4561-ae77-a019b089d846 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:17.574210 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e77400d3-5795-4561-ae77-a019b089d846 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:17.575236 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e77400d3-5795-4561-ae77-a019b089d846 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:17.575966 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e77400d3-5795-4561-ae77-a019b089d846 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:17.584458 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e77400d3-5795-4561-ae77-a019b089d846 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:17.591411 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=100 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:17.719924 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-cc6b5d18-007b-41ac-9696-0c8d88d46fcd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:17.758047 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-cc6b5d18-007b-41ac-9696-0c8d88d46fcd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.356591 Sep 26 18:04:17.759239 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 57/121] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:17 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:17.814181 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e77400d3-5795-4561-ae77-a019b089d846 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:17.822484 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e77400d3-5795-4561-ae77-a019b089d846 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.261675 Sep 26 18:04:17.823168 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 65/122] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:17 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:18.588152 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-73d43b62-6e85-4d9b-b0fc-03129f5d4525 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:18.588902 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-73d43b62-6e85-4d9b-b0fc-03129f5d4525 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:18.597433 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-73d43b62-6e85-4d9b-b0fc-03129f5d4525 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:18.597963 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-73d43b62-6e85-4d9b-b0fc-03129f5d4525 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:18.598572 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-73d43b62-6e85-4d9b-b0fc-03129f5d4525 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:18.599608 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-73d43b62-6e85-4d9b-b0fc-03129f5d4525 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:18.600076 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-73d43b62-6e85-4d9b-b0fc-03129f5d4525 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:18.600502 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-73d43b62-6e85-4d9b-b0fc-03129f5d4525 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:18.772708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-73d43b62-6e85-4d9b-b0fc-03129f5d4525 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:18.786841 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-73d43b62-6e85-4d9b-b0fc-03129f5d4525 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.202316 Sep 26 18:04:18.787469 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 58/123] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:18 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:18.791959 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2e63d1f8-a94d-4729-92e7-87ac71db240b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:18.800576 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2e63d1f8-a94d-4729-92e7-87ac71db240b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:18.820594 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2e63d1f8-a94d-4729-92e7-87ac71db240b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:18.821747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2e63d1f8-a94d-4729-92e7-87ac71db240b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:18.822339 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2e63d1f8-a94d-4729-92e7-87ac71db240b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:18.823196 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2e63d1f8-a94d-4729-92e7-87ac71db240b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:18.823833 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2e63d1f8-a94d-4729-92e7-87ac71db240b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:18.824405 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2e63d1f8-a94d-4729-92e7-87ac71db240b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:18.858069 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7e50cc99-a4e2-43b0-b4b2-9edea0ab4f9c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:18.858874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7e50cc99-a4e2-43b0-b4b2-9edea0ab4f9c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:18.868181 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e50cc99-a4e2-43b0-b4b2-9edea0ab4f9c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:18.868872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e50cc99-a4e2-43b0-b4b2-9edea0ab4f9c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:18.869288 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e50cc99-a4e2-43b0-b4b2-9edea0ab4f9c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:18.869997 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e50cc99-a4e2-43b0-b4b2-9edea0ab4f9c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:18.870460 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e50cc99-a4e2-43b0-b4b2-9edea0ab4f9c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:18.870885 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e50cc99-a4e2-43b0-b4b2-9edea0ab4f9c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:19.187244 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2e63d1f8-a94d-4729-92e7-87ac71db240b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:19.200238 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2e63d1f8-a94d-4729-92e7-87ac71db240b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.412221 Sep 26 18:04:19.200818 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 66/124] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:18 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:19.207073 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-892165f1-1a4b-40b7-be2a-633d5f65f82d req-ed4b6b3a-85ac-48e4-b69a-7dfe69fd2441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220b1da2-7651-436f-ab85-1d16ee3ecea0", "name": "network-vif-plugged", "status": "completed", "tag": "9ef108b0-8394-4e0e-8563-6390415fb8c4"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:19.219302 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-892165f1-1a4b-40b7-be2a-633d5f65f82d req-ed4b6b3a-85ac-48e4-b69a-7dfe69fd2441 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:19.220470 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-892165f1-1a4b-40b7-be2a-633d5f65f82d req-ed4b6b3a-85ac-48e4-b69a-7dfe69fd2441 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:19.221399 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-892165f1-1a4b-40b7-be2a-633d5f65f82d req-ed4b6b3a-85ac-48e4-b69a-7dfe69fd2441 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:19.239297 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-892165f1-1a4b-40b7-be2a-633d5f65f82d req-ed4b6b3a-85ac-48e4-b69a-7dfe69fd2441 service nova] Creating event network-vif-plugged:9ef108b0-8394-4e0e-8563-6390415fb8c4 for instance 220b1da2-7651-436f-ab85-1d16ee3ecea0 on hv-cinder-85931 Sep 26 18:04:19.245376 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-892165f1-1a4b-40b7-be2a-633d5f65f82d req-ed4b6b3a-85ac-48e4-b69a-7dfe69fd2441 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042786 Sep 26 18:04:19.245978 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 67/125] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:19.258152 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7e50cc99-a4e2-43b0-b4b2-9edea0ab4f9c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:19.272037 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7e50cc99-a4e2-43b0-b4b2-9edea0ab4f9c tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.414421 Sep 26 18:04:19.272037 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 59/126] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:18 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:19.813235 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-96250bda-2fac-4b41-85bf-de85f85fe703 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:19.813944 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-96250bda-2fac-4b41-85bf-de85f85fe703 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:19.822092 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-96250bda-2fac-4b41-85bf-de85f85fe703 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:19.822624 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-96250bda-2fac-4b41-85bf-de85f85fe703 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:19.823346 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-96250bda-2fac-4b41-85bf-de85f85fe703 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:19.825347 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-96250bda-2fac-4b41-85bf-de85f85fe703 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:19.825982 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-96250bda-2fac-4b41-85bf-de85f85fe703 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:19.826477 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-96250bda-2fac-4b41-85bf-de85f85fe703 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:19.996291 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-96250bda-2fac-4b41-85bf-de85f85fe703 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:20.005094 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-96250bda-2fac-4b41-85bf-de85f85fe703 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.195718 Sep 26 18:04:20.006171 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 68/127] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:19 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:20.235453 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1625226e-214c-4f88-97bd-6a189b4e427a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:20.236208 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1625226e-214c-4f88-97bd-6a189b4e427a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:20.242543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1625226e-214c-4f88-97bd-6a189b4e427a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:20.243023 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1625226e-214c-4f88-97bd-6a189b4e427a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:20.243451 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1625226e-214c-4f88-97bd-6a189b4e427a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:20.244169 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1625226e-214c-4f88-97bd-6a189b4e427a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:20.244630 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1625226e-214c-4f88-97bd-6a189b4e427a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:20.245049 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1625226e-214c-4f88-97bd-6a189b4e427a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:20.264554 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=100 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:20.292815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-03f22d26-76fc-46b2-8fde-ac271596e36e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:20.293415 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-03f22d26-76fc-46b2-8fde-ac271596e36e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:20.302486 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-03f22d26-76fc-46b2-8fde-ac271596e36e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:20.302888 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-03f22d26-76fc-46b2-8fde-ac271596e36e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:20.303319 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-03f22d26-76fc-46b2-8fde-ac271596e36e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:20.304041 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-03f22d26-76fc-46b2-8fde-ac271596e36e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:20.304494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-03f22d26-76fc-46b2-8fde-ac271596e36e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:20.304912 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-03f22d26-76fc-46b2-8fde-ac271596e36e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:20.491412 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1625226e-214c-4f88-97bd-6a189b4e427a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:20.500061 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1625226e-214c-4f88-97bd-6a189b4e427a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.268600 Sep 26 18:04:20.501185 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 60/128] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:20 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:20.549042 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-03f22d26-76fc-46b2-8fde-ac271596e36e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:20.567776 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-03f22d26-76fc-46b2-8fde-ac271596e36e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1314 microversion: 2.1 time: 0.276591 Sep 26 18:04:20.568783 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 69/129] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:20 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:21.033272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-783fad40-d0cb-482e-805e-b63bf4672856 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:21.034700 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-783fad40-d0cb-482e-805e-b63bf4672856 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:21.049367 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-783fad40-d0cb-482e-805e-b63bf4672856 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:21.050311 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-783fad40-d0cb-482e-805e-b63bf4672856 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:21.050991 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-783fad40-d0cb-482e-805e-b63bf4672856 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:21.051787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-783fad40-d0cb-482e-805e-b63bf4672856 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:21.052365 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-783fad40-d0cb-482e-805e-b63bf4672856 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:21.052967 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-783fad40-d0cb-482e-805e-b63bf4672856 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:21.263631 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-ad959c80-fe11-45a7-be5e-e78145d03b6b req-51493f74-7941-4dbd-9253-5188558139d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9682673d-b9ac-49a7-9f72-eef56dcbac73", "name": "network-vif-plugged", "status": "completed", "tag": "88d9ddc3-ae2c-428a-b7ad-f212435e977b"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:21.281003 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-ad959c80-fe11-45a7-be5e-e78145d03b6b req-51493f74-7941-4dbd-9253-5188558139d8 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:21.282493 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-ad959c80-fe11-45a7-be5e-e78145d03b6b req-51493f74-7941-4dbd-9253-5188558139d8 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:21.283363 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-ad959c80-fe11-45a7-be5e-e78145d03b6b req-51493f74-7941-4dbd-9253-5188558139d8 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:21.304095 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-ad959c80-fe11-45a7-be5e-e78145d03b6b req-51493f74-7941-4dbd-9253-5188558139d8 service nova] Creating event network-vif-plugged:88d9ddc3-ae2c-428a-b7ad-f212435e977b for instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 on hv-cinder-85931 Sep 26 18:04:21.327079 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-ad959c80-fe11-45a7-be5e-e78145d03b6b req-51493f74-7941-4dbd-9253-5188558139d8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066571 Sep 26 18:04:21.329058 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 70/130] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:04:21.549842 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-75affb8c-ceb8-4a64-8002-66c0dcb06a49 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:21.551399 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-75affb8c-ceb8-4a64-8002-66c0dcb06a49 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:21.565793 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75affb8c-ceb8-4a64-8002-66c0dcb06a49 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:21.567069 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75affb8c-ceb8-4a64-8002-66c0dcb06a49 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:21.569016 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75affb8c-ceb8-4a64-8002-66c0dcb06a49 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:21.570427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75affb8c-ceb8-4a64-8002-66c0dcb06a49 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:21.571327 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75affb8c-ceb8-4a64-8002-66c0dcb06a49 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:21.572091 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75affb8c-ceb8-4a64-8002-66c0dcb06a49 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:21.667314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-783fad40-d0cb-482e-805e-b63bf4672856 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:21.686190 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-783fad40-d0cb-482e-805e-b63bf4672856 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.659859 Sep 26 18:04:21.696271 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 61/131] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:21 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:21.722857 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-25364cb2-ad2d-4753-b5b2-9281b5ba2c20 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:21.724265 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-25364cb2-ad2d-4753-b5b2-9281b5ba2c20 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:21.732401 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-25364cb2-ad2d-4753-b5b2-9281b5ba2c20 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:21.733095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-25364cb2-ad2d-4753-b5b2-9281b5ba2c20 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:21.733747 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-25364cb2-ad2d-4753-b5b2-9281b5ba2c20 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:21.734807 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-25364cb2-ad2d-4753-b5b2-9281b5ba2c20 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:21.735797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-25364cb2-ad2d-4753-b5b2-9281b5ba2c20 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:21.736715 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-25364cb2-ad2d-4753-b5b2-9281b5ba2c20 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:21.970183 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-75affb8c-ceb8-4a64-8002-66c0dcb06a49 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:21.984531 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-75affb8c-ceb8-4a64-8002-66c0dcb06a49 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.441252 Sep 26 18:04:21.984531 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 71/132] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:21 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:22.123030 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-25364cb2-ad2d-4753-b5b2-9281b5ba2c20 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:22.134477 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-25364cb2-ad2d-4753-b5b2-9281b5ba2c20 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1500 microversion: 2.1 time: 0.436438 Sep 26 18:04:22.152161 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 62/133] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:21 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1500 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:22.731217 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-607f659c-a052-4a2c-be69-5acf4c08a86c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:22.745582 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-607f659c-a052-4a2c-be69-5acf4c08a86c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:22.753987 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-607f659c-a052-4a2c-be69-5acf4c08a86c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:22.755330 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-607f659c-a052-4a2c-be69-5acf4c08a86c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:22.755793 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-607f659c-a052-4a2c-be69-5acf4c08a86c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:22.756495 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-607f659c-a052-4a2c-be69-5acf4c08a86c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:22.756946 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-607f659c-a052-4a2c-be69-5acf4c08a86c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:22.757565 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-607f659c-a052-4a2c-be69-5acf4c08a86c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:22.933182 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-607f659c-a052-4a2c-be69-5acf4c08a86c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:22.943048 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-607f659c-a052-4a2c-be69-5acf4c08a86c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1321 microversion: 2.1 time: 0.214645 Sep 26 18:04:22.944327 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 72/134] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:22 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:23.025796 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-067d4a3f-dfb8-4281-a7cc-5e57de1e2f15 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:23.026618 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-067d4a3f-dfb8-4281-a7cc-5e57de1e2f15 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:23.032906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-067d4a3f-dfb8-4281-a7cc-5e57de1e2f15 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:23.033398 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-067d4a3f-dfb8-4281-a7cc-5e57de1e2f15 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:23.033842 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-067d4a3f-dfb8-4281-a7cc-5e57de1e2f15 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:23.034540 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-067d4a3f-dfb8-4281-a7cc-5e57de1e2f15 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:23.035000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-067d4a3f-dfb8-4281-a7cc-5e57de1e2f15 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:23.035423 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-067d4a3f-dfb8-4281-a7cc-5e57de1e2f15 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:23.201330 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-067d4a3f-dfb8-4281-a7cc-5e57de1e2f15 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:23.210481 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-067d4a3f-dfb8-4281-a7cc-5e57de1e2f15 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.188376 Sep 26 18:04:23.224946 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 63/135] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:23 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:23.976751 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-323a48ba-fa35-4998-9651-b6800350f73d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:23.977948 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-323a48ba-fa35-4998-9651-b6800350f73d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:23.984328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-323a48ba-fa35-4998-9651-b6800350f73d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:23.985019 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-323a48ba-fa35-4998-9651-b6800350f73d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:23.985642 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-323a48ba-fa35-4998-9651-b6800350f73d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:23.986505 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-323a48ba-fa35-4998-9651-b6800350f73d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:23.987111 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-323a48ba-fa35-4998-9651-b6800350f73d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:23.987793 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-323a48ba-fa35-4998-9651-b6800350f73d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:24.150611 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-323a48ba-fa35-4998-9651-b6800350f73d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:24.161320 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-323a48ba-fa35-4998-9651-b6800350f73d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1514 microversion: 2.1 time: 0.189159 Sep 26 18:04:24.176420 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 73/136] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:23 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:24.186073 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-58b94f1e-164e-4399-8ffc-603fd6562d62 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:24.188411 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-58b94f1e-164e-4399-8ffc-603fd6562d62 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:24.203855 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-58b94f1e-164e-4399-8ffc-603fd6562d62 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:24.204859 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-58b94f1e-164e-4399-8ffc-603fd6562d62 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:24.205722 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-58b94f1e-164e-4399-8ffc-603fd6562d62 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:24.207245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-58b94f1e-164e-4399-8ffc-603fd6562d62 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:24.208771 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-58b94f1e-164e-4399-8ffc-603fd6562d62 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:24.209680 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-58b94f1e-164e-4399-8ffc-603fd6562d62 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:24.238930 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a9dd0330-aff0-4632-bcc5-3727e16ff7aa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:24.240546 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a9dd0330-aff0-4632-bcc5-3727e16ff7aa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:24.249032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a9dd0330-aff0-4632-bcc5-3727e16ff7aa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:24.249751 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a9dd0330-aff0-4632-bcc5-3727e16ff7aa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:24.250342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a9dd0330-aff0-4632-bcc5-3727e16ff7aa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:24.251371 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a9dd0330-aff0-4632-bcc5-3727e16ff7aa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:24.252004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a9dd0330-aff0-4632-bcc5-3727e16ff7aa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:24.252437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a9dd0330-aff0-4632-bcc5-3727e16ff7aa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:24.290438 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-58b94f1e-164e-4399-8ffc-603fd6562d62 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lazy-loading 'flavor' on Instance uuid 220b1da2-7651-436f-ab85-1d16ee3ecea0 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:04:24.464984 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a9dd0330-aff0-4632-bcc5-3727e16ff7aa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:24.482167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a9dd0330-aff0-4632-bcc5-3727e16ff7aa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1366 microversion: 2.1 time: 0.247740 Sep 26 18:04:24.496745 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 74/137] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:24 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:24.922024 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-58b94f1e-164e-4399-8ffc-603fd6562d62 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "POST /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0/action" status: 200 len: 32 microversion: 2.1 time: 0.740119 Sep 26 18:04:24.922870 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 64/138] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Sep 26 18:04:24 2022] POST /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0/action => generated 32 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 18:04:24.946366 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1b48ef8f-9eef-4044-817d-84b9551d3780 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:24.947462 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1b48ef8f-9eef-4044-817d-84b9551d3780 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:24.974020 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1b48ef8f-9eef-4044-817d-84b9551d3780 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:24.974020 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1b48ef8f-9eef-4044-817d-84b9551d3780 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:24.974020 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1b48ef8f-9eef-4044-817d-84b9551d3780 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:24.974020 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1b48ef8f-9eef-4044-817d-84b9551d3780 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:24.974300 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1b48ef8f-9eef-4044-817d-84b9551d3780 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:24.974300 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1b48ef8f-9eef-4044-817d-84b9551d3780 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:25.175067 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1b48ef8f-9eef-4044-817d-84b9551d3780 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:25.195492 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1b48ef8f-9eef-4044-817d-84b9551d3780 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.255020 Sep 26 18:04:25.196388 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 75/139] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:24 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:25.527078 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-700caa14-4fe0-4804-bbdb-78fcab94ff31 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:25.528972 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-700caa14-4fe0-4804-bbdb-78fcab94ff31 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:25.540103 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-700caa14-4fe0-4804-bbdb-78fcab94ff31 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:25.541072 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-700caa14-4fe0-4804-bbdb-78fcab94ff31 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:25.544417 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-700caa14-4fe0-4804-bbdb-78fcab94ff31 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:25.545373 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-700caa14-4fe0-4804-bbdb-78fcab94ff31 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:25.546054 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-700caa14-4fe0-4804-bbdb-78fcab94ff31 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:25.546646 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-700caa14-4fe0-4804-bbdb-78fcab94ff31 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:25.842147 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-700caa14-4fe0-4804-bbdb-78fcab94ff31 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:25.852158 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-700caa14-4fe0-4804-bbdb-78fcab94ff31 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1556 microversion: 2.1 time: 0.329242 Sep 26 18:04:25.852749 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 65/140] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:25 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1556 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:25.882464 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4b934874-38b2-4d14-b3c4-4b2036ab85c1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:25.882464 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4b934874-38b2-4d14-b3c4-4b2036ab85c1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:25.886472 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4b934874-38b2-4d14-b3c4-4b2036ab85c1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:25.887019 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4b934874-38b2-4d14-b3c4-4b2036ab85c1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:25.887440 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4b934874-38b2-4d14-b3c4-4b2036ab85c1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:25.888179 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4b934874-38b2-4d14-b3c4-4b2036ab85c1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:25.888629 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4b934874-38b2-4d14-b3c4-4b2036ab85c1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:25.889106 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4b934874-38b2-4d14-b3c4-4b2036ab85c1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:26.057550 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a2854164-f714-4241-9f9a-e7237b93835e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55a17ee1-3730-4875-9c8a-220098b1dac7"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:26.060071 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a2854164-f714-4241-9f9a-e7237b93835e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:26.071183 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a2854164-f714-4241-9f9a-e7237b93835e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:26.072182 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a2854164-f714-4241-9f9a-e7237b93835e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:26.072888 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a2854164-f714-4241-9f9a-e7237b93835e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:26.075121 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a2854164-f714-4241-9f9a-e7237b93835e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:26.076165 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a2854164-f714-4241-9f9a-e7237b93835e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:26.077759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a2854164-f714-4241-9f9a-e7237b93835e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:26.162825 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4b934874-38b2-4d14-b3c4-4b2036ab85c1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.290219 Sep 26 18:04:26.164230 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 76/141] 10.222.0.67 () {58 vars in 1275 bytes} [Mon Sep 26 18:04:25 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73/os-interface => generated 284 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:26.227011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-fb3c6ffe-7dc5-466c-aec6-35e33d1144bf tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:26.228016 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-fb3c6ffe-7dc5-466c-aec6-35e33d1144bf tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:26.248328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fb3c6ffe-7dc5-466c-aec6-35e33d1144bf tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:26.248828 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fb3c6ffe-7dc5-466c-aec6-35e33d1144bf tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:26.249265 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fb3c6ffe-7dc5-466c-aec6-35e33d1144bf tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:26.249976 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fb3c6ffe-7dc5-466c-aec6-35e33d1144bf tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:26.250433 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fb3c6ffe-7dc5-466c-aec6-35e33d1144bf tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:26.250857 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fb3c6ffe-7dc5-466c-aec6-35e33d1144bf tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:26.580667 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-fb3c6ffe-7dc5-466c-aec6-35e33d1144bf tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:26.602385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-fb3c6ffe-7dc5-466c-aec6-35e33d1144bf tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.379735 Sep 26 18:04:26.603293 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 77/142] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:26 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:27.628168 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c1092828-035a-4129-bcdc-9e1f2791904b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:27.628868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c1092828-035a-4129-bcdc-9e1f2791904b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:27.631217 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=85 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:27.637079 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1092828-035a-4129-bcdc-9e1f2791904b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:27.638142 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1092828-035a-4129-bcdc-9e1f2791904b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:27.641137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1092828-035a-4129-bcdc-9e1f2791904b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:27.641137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1092828-035a-4129-bcdc-9e1f2791904b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:27.641137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1092828-035a-4129-bcdc-9e1f2791904b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:27.642668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1092828-035a-4129-bcdc-9e1f2791904b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:27.835614 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c1092828-035a-4129-bcdc-9e1f2791904b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:27.846282 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c1092828-035a-4129-bcdc-9e1f2791904b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.221897 Sep 26 18:04:27.847028 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 78/143] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:27 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:28.230800 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-d85e8d9e-d3b4-4686-89a3-5e8d69295f50 req-4c03e425-fb5f-4507-8505-a64b66929d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9682673d-b9ac-49a7-9f72-eef56dcbac73", "tag": "88d9ddc3-ae2c-428a-b7ad-f212435e977b"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:04:28.243360 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-d85e8d9e-d3b4-4686-89a3-5e8d69295f50 req-4c03e425-fb5f-4507-8505-a64b66929d90 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:28.243360 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-d85e8d9e-d3b4-4686-89a3-5e8d69295f50 req-4c03e425-fb5f-4507-8505-a64b66929d90 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:28.243360 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-d85e8d9e-d3b4-4686-89a3-5e8d69295f50 req-4c03e425-fb5f-4507-8505-a64b66929d90 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:28.256927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-d85e8d9e-d3b4-4686-89a3-5e8d69295f50 req-4c03e425-fb5f-4507-8505-a64b66929d90 service nova] Creating event network-changed:88d9ddc3-ae2c-428a-b7ad-f212435e977b for instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 on hv-cinder-85931 Sep 26 18:04:28.264256 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-d85e8d9e-d3b4-4686-89a3-5e8d69295f50 req-4c03e425-fb5f-4507-8505-a64b66929d90 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037925 Sep 26 18:04:28.265726 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 79/144] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:04:28.877184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-7a11cb81-bc1f-4ef8-890d-3fd59a0420e6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:28.878028 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-7a11cb81-bc1f-4ef8-890d-3fd59a0420e6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:28.895797 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a11cb81-bc1f-4ef8-890d-3fd59a0420e6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:28.896997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a11cb81-bc1f-4ef8-890d-3fd59a0420e6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:28.897813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a11cb81-bc1f-4ef8-890d-3fd59a0420e6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:28.899357 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a11cb81-bc1f-4ef8-890d-3fd59a0420e6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:28.900179 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a11cb81-bc1f-4ef8-890d-3fd59a0420e6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:28.900907 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a11cb81-bc1f-4ef8-890d-3fd59a0420e6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:29.144698 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a2854164-f714-4241-9f9a-e7237b93835e tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "POST /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.084982 Sep 26 18:04:29.152241 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 66/145] 10.222.0.67 () {60 vars in 1323 bytes} [Mon Sep 26 18:04:26 2022] POST /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4/os-volume_attachments => generated 194 bytes in 3101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:04:29.326465 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-7a11cb81-bc1f-4ef8-890d-3fd59a0420e6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:29.356233 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-7a11cb81-bc1f-4ef8-890d-3fd59a0420e6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.481119 Sep 26 18:04:29.356233 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 80/146] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:28 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:30.381269 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-eb4a9e08-4402-4443-a2c4-354eff41e169 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:30.382504 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-eb4a9e08-4402-4443-a2c4-354eff41e169 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:30.386955 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=73 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:30.396654 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eb4a9e08-4402-4443-a2c4-354eff41e169 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:30.397150 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eb4a9e08-4402-4443-a2c4-354eff41e169 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:30.397580 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eb4a9e08-4402-4443-a2c4-354eff41e169 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:30.398385 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eb4a9e08-4402-4443-a2c4-354eff41e169 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:30.399145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eb4a9e08-4402-4443-a2c4-354eff41e169 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:30.399566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eb4a9e08-4402-4443-a2c4-354eff41e169 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:30.564552 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-eb4a9e08-4402-4443-a2c4-354eff41e169 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:30.575536 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-eb4a9e08-4402-4443-a2c4-354eff41e169 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.199591 Sep 26 18:04:30.576575 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 67/147] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:30 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:31.600376 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ec2d8984-7b3e-4df5-b848-8c9e8986434e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:31.602378 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ec2d8984-7b3e-4df5-b848-8c9e8986434e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:31.608826 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ec2d8984-7b3e-4df5-b848-8c9e8986434e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:31.609330 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ec2d8984-7b3e-4df5-b848-8c9e8986434e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:31.609766 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ec2d8984-7b3e-4df5-b848-8c9e8986434e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:31.610675 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ec2d8984-7b3e-4df5-b848-8c9e8986434e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:31.611136 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ec2d8984-7b3e-4df5-b848-8c9e8986434e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:31.611569 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ec2d8984-7b3e-4df5-b848-8c9e8986434e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:31.784890 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ec2d8984-7b3e-4df5-b848-8c9e8986434e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:31.797956 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ec2d8984-7b3e-4df5-b848-8c9e8986434e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.198318 Sep 26 18:04:31.801859 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 81/148] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:31 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:32.822717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-966346bb-4fdb-4b7f-9e69-bb4b8d19859c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:32.824483 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-966346bb-4fdb-4b7f-9e69-bb4b8d19859c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:32.838280 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-966346bb-4fdb-4b7f-9e69-bb4b8d19859c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:32.841861 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-966346bb-4fdb-4b7f-9e69-bb4b8d19859c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:32.841861 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-966346bb-4fdb-4b7f-9e69-bb4b8d19859c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:32.841861 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-966346bb-4fdb-4b7f-9e69-bb4b8d19859c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:32.842250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-966346bb-4fdb-4b7f-9e69-bb4b8d19859c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:32.842959 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-966346bb-4fdb-4b7f-9e69-bb4b8d19859c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:33.011923 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-966346bb-4fdb-4b7f-9e69-bb4b8d19859c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:33.020516 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-966346bb-4fdb-4b7f-9e69-bb4b8d19859c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.203867 Sep 26 18:04:33.021216 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 68/149] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:32 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:34.046710 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-5725ad22-9943-4070-80a5-b712f3b0c79f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:34.047325 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-5725ad22-9943-4070-80a5-b712f3b0c79f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:34.053295 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5725ad22-9943-4070-80a5-b712f3b0c79f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:34.053786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5725ad22-9943-4070-80a5-b712f3b0c79f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:34.054391 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5725ad22-9943-4070-80a5-b712f3b0c79f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:34.054963 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5725ad22-9943-4070-80a5-b712f3b0c79f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:34.056097 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5725ad22-9943-4070-80a5-b712f3b0c79f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:34.056854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5725ad22-9943-4070-80a5-b712f3b0c79f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:34.194166 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-5725ad22-9943-4070-80a5-b712f3b0c79f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:34.202093 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-5725ad22-9943-4070-80a5-b712f3b0c79f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.159849 Sep 26 18:04:34.202655 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 82/150] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:34 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:35.227903 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-19bbf9cc-1297-40ec-bad9-94b3f8acba6e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:35.229293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-19bbf9cc-1297-40ec-bad9-94b3f8acba6e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:35.236921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-19bbf9cc-1297-40ec-bad9-94b3f8acba6e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:35.237608 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-19bbf9cc-1297-40ec-bad9-94b3f8acba6e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:35.238053 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-19bbf9cc-1297-40ec-bad9-94b3f8acba6e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:35.238943 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-19bbf9cc-1297-40ec-bad9-94b3f8acba6e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:35.239671 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-19bbf9cc-1297-40ec-bad9-94b3f8acba6e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:35.240110 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-19bbf9cc-1297-40ec-bad9-94b3f8acba6e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:35.378813 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-19bbf9cc-1297-40ec-bad9-94b3f8acba6e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:35.388517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-19bbf9cc-1297-40ec-bad9-94b3f8acba6e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.165608 Sep 26 18:04:35.389093 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 69/151] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:35 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:36.422190 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-caa4a667-a6a4-4def-8801-6cf0539d78bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:36.422786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-caa4a667-a6a4-4def-8801-6cf0539d78bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:36.429477 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-caa4a667-a6a4-4def-8801-6cf0539d78bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:36.429966 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-caa4a667-a6a4-4def-8801-6cf0539d78bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:36.430400 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-caa4a667-a6a4-4def-8801-6cf0539d78bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:36.431181 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-caa4a667-a6a4-4def-8801-6cf0539d78bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:36.431855 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-caa4a667-a6a4-4def-8801-6cf0539d78bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:36.433274 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-caa4a667-a6a4-4def-8801-6cf0539d78bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:36.593569 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-caa4a667-a6a4-4def-8801-6cf0539d78bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:36.604954 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-caa4a667-a6a4-4def-8801-6cf0539d78bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.195163 Sep 26 18:04:36.605542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 83/152] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:36 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:37.628418 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f81f5c71-4272-4110-bc11-ec3672ef93f2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:37.629116 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f81f5c71-4272-4110-bc11-ec3672ef93f2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:37.636414 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f81f5c71-4272-4110-bc11-ec3672ef93f2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:37.636832 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f81f5c71-4272-4110-bc11-ec3672ef93f2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:37.637263 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f81f5c71-4272-4110-bc11-ec3672ef93f2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:37.637953 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f81f5c71-4272-4110-bc11-ec3672ef93f2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:37.638410 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f81f5c71-4272-4110-bc11-ec3672ef93f2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:37.638830 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f81f5c71-4272-4110-bc11-ec3672ef93f2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:37.777915 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f81f5c71-4272-4110-bc11-ec3672ef93f2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:37.787046 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f81f5c71-4272-4110-bc11-ec3672ef93f2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.162423 Sep 26 18:04:37.787461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 70/153] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:37 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:38.811670 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-be75177f-93b9-4f71-a543-3d7b95472e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:38.812281 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-be75177f-93b9-4f71-a543-3d7b95472e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:38.819841 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be75177f-93b9-4f71-a543-3d7b95472e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:38.820338 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be75177f-93b9-4f71-a543-3d7b95472e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:38.820772 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be75177f-93b9-4f71-a543-3d7b95472e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:38.821474 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be75177f-93b9-4f71-a543-3d7b95472e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:38.821925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be75177f-93b9-4f71-a543-3d7b95472e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:38.822346 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be75177f-93b9-4f71-a543-3d7b95472e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:38.826821 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=100 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:38.973770 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-be75177f-93b9-4f71-a543-3d7b95472e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:38.985548 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-be75177f-93b9-4f71-a543-3d7b95472e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.177043 Sep 26 18:04:38.986059 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 84/154] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:38 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:40.011305 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-3e947bc2-1262-4ad1-8023-a432b84bb9ad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:40.012667 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3e947bc2-1262-4ad1-8023-a432b84bb9ad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:40.019204 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3e947bc2-1262-4ad1-8023-a432b84bb9ad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:40.019766 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3e947bc2-1262-4ad1-8023-a432b84bb9ad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:40.020206 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3e947bc2-1262-4ad1-8023-a432b84bb9ad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:40.020939 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3e947bc2-1262-4ad1-8023-a432b84bb9ad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:40.021335 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3e947bc2-1262-4ad1-8023-a432b84bb9ad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:40.021749 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3e947bc2-1262-4ad1-8023-a432b84bb9ad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:40.193309 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3e947bc2-1262-4ad1-8023-a432b84bb9ad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:40.202741 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-3e947bc2-1262-4ad1-8023-a432b84bb9ad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.194402 Sep 26 18:04:40.202741 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 71/155] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:40 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:41.230966 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-92b0d2cf-1e97-428a-9a19-d58869b49b58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:41.237091 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-92b0d2cf-1e97-428a-9a19-d58869b49b58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:41.254497 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92b0d2cf-1e97-428a-9a19-d58869b49b58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:41.255502 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92b0d2cf-1e97-428a-9a19-d58869b49b58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:41.256886 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92b0d2cf-1e97-428a-9a19-d58869b49b58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:41.257939 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92b0d2cf-1e97-428a-9a19-d58869b49b58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:41.258651 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92b0d2cf-1e97-428a-9a19-d58869b49b58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:41.259310 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92b0d2cf-1e97-428a-9a19-d58869b49b58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:41.448045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-92b0d2cf-1e97-428a-9a19-d58869b49b58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:41.456430 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-92b0d2cf-1e97-428a-9a19-d58869b49b58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.231341 Sep 26 18:04:41.457009 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 85/156] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:41 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:42.482559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b1692274-6d2a-4b86-b997-659150e4479f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:42.490849 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b1692274-6d2a-4b86-b997-659150e4479f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:42.493142 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1692274-6d2a-4b86-b997-659150e4479f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:42.500710 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1692274-6d2a-4b86-b997-659150e4479f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:42.501224 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1692274-6d2a-4b86-b997-659150e4479f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:42.502084 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1692274-6d2a-4b86-b997-659150e4479f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:42.502913 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1692274-6d2a-4b86-b997-659150e4479f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:42.504446 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1692274-6d2a-4b86-b997-659150e4479f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:42.701942 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b1692274-6d2a-4b86-b997-659150e4479f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:42.712299 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b1692274-6d2a-4b86-b997-659150e4479f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.235726 Sep 26 18:04:42.713084 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 72/157] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:42 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:43.744785 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e68c168a-178e-4e66-bdcc-6ba730906d71 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:43.745724 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e68c168a-178e-4e66-bdcc-6ba730906d71 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:43.753218 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e68c168a-178e-4e66-bdcc-6ba730906d71 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:43.753994 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e68c168a-178e-4e66-bdcc-6ba730906d71 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:43.754341 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e68c168a-178e-4e66-bdcc-6ba730906d71 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:43.755151 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e68c168a-178e-4e66-bdcc-6ba730906d71 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:43.755598 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e68c168a-178e-4e66-bdcc-6ba730906d71 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:43.756038 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e68c168a-178e-4e66-bdcc-6ba730906d71 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:43.994162 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e68c168a-178e-4e66-bdcc-6ba730906d71 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:44.003506 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e68c168a-178e-4e66-bdcc-6ba730906d71 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.269953 Sep 26 18:04:44.005099 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 86/158] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:43 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:45.029553 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-26c6e62a-3a28-4863-9fe8-f40df5375dbe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:45.030354 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-26c6e62a-3a28-4863-9fe8-f40df5375dbe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:45.040174 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26c6e62a-3a28-4863-9fe8-f40df5375dbe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:45.040174 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26c6e62a-3a28-4863-9fe8-f40df5375dbe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:45.040174 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26c6e62a-3a28-4863-9fe8-f40df5375dbe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:45.040467 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26c6e62a-3a28-4863-9fe8-f40df5375dbe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:45.040906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26c6e62a-3a28-4863-9fe8-f40df5375dbe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:45.041339 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26c6e62a-3a28-4863-9fe8-f40df5375dbe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:45.224663 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-26c6e62a-3a28-4863-9fe8-f40df5375dbe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:45.228259 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:45.232934 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-26c6e62a-3a28-4863-9fe8-f40df5375dbe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.207309 Sep 26 18:04:45.233828 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 73/159] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:45 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:46.259160 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f7eeebb8-5f59-41bc-aed7-eafb7fab9dad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:46.260479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f7eeebb8-5f59-41bc-aed7-eafb7fab9dad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:46.270875 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f7eeebb8-5f59-41bc-aed7-eafb7fab9dad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:46.271690 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f7eeebb8-5f59-41bc-aed7-eafb7fab9dad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:46.272433 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f7eeebb8-5f59-41bc-aed7-eafb7fab9dad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:46.273591 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f7eeebb8-5f59-41bc-aed7-eafb7fab9dad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:46.274364 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f7eeebb8-5f59-41bc-aed7-eafb7fab9dad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:46.275044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f7eeebb8-5f59-41bc-aed7-eafb7fab9dad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:46.411836 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f7eeebb8-5f59-41bc-aed7-eafb7fab9dad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:46.419759 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f7eeebb8-5f59-41bc-aed7-eafb7fab9dad tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.165865 Sep 26 18:04:46.420356 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 87/160] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:46 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:47.443853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-82c7e6f3-74d0-4eec-b751-6e617f64ebca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:47.444508 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-82c7e6f3-74d0-4eec-b751-6e617f64ebca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:47.451262 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-82c7e6f3-74d0-4eec-b751-6e617f64ebca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:47.451773 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-82c7e6f3-74d0-4eec-b751-6e617f64ebca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:47.452209 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-82c7e6f3-74d0-4eec-b751-6e617f64ebca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:47.452893 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-82c7e6f3-74d0-4eec-b751-6e617f64ebca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:47.453397 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-82c7e6f3-74d0-4eec-b751-6e617f64ebca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:47.453911 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-82c7e6f3-74d0-4eec-b751-6e617f64ebca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:47.641210 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-82c7e6f3-74d0-4eec-b751-6e617f64ebca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:47.650315 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-82c7e6f3-74d0-4eec-b751-6e617f64ebca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.211221 Sep 26 18:04:47.650874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 74/161] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:47 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:48.680590 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-afcb8a5c-f4fd-47d3-80c3-8aae7bfa7ce7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:48.680590 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-afcb8a5c-f4fd-47d3-80c3-8aae7bfa7ce7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:48.688126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-afcb8a5c-f4fd-47d3-80c3-8aae7bfa7ce7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:48.688884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-afcb8a5c-f4fd-47d3-80c3-8aae7bfa7ce7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:48.689384 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-afcb8a5c-f4fd-47d3-80c3-8aae7bfa7ce7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:48.690257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-afcb8a5c-f4fd-47d3-80c3-8aae7bfa7ce7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:48.690921 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-afcb8a5c-f4fd-47d3-80c3-8aae7bfa7ce7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:48.692736 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-afcb8a5c-f4fd-47d3-80c3-8aae7bfa7ce7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:48.858274 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-afcb8a5c-f4fd-47d3-80c3-8aae7bfa7ce7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:48.870061 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-afcb8a5c-f4fd-47d3-80c3-8aae7bfa7ce7 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.200224 Sep 26 18:04:48.870691 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 88/162] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:48 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:49.893737 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-26514548-ab97-4b76-9895-eca805cae5de tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:49.895327 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-26514548-ab97-4b76-9895-eca805cae5de tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:49.904143 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26514548-ab97-4b76-9895-eca805cae5de tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:49.904642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26514548-ab97-4b76-9895-eca805cae5de tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:49.905080 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26514548-ab97-4b76-9895-eca805cae5de tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:49.905784 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26514548-ab97-4b76-9895-eca805cae5de tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:49.906253 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26514548-ab97-4b76-9895-eca805cae5de tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:49.906678 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26514548-ab97-4b76-9895-eca805cae5de tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:50.055680 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-26514548-ab97-4b76-9895-eca805cae5de tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:50.064134 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-26514548-ab97-4b76-9895-eca805cae5de tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.174258 Sep 26 18:04:50.064699 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 75/163] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:49 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:51.092950 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4ac2ef7b-146b-4b97-8f92-5df620163e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:51.094872 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4ac2ef7b-146b-4b97-8f92-5df620163e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:51.108507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ac2ef7b-146b-4b97-8f92-5df620163e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:51.109348 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ac2ef7b-146b-4b97-8f92-5df620163e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:51.110095 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ac2ef7b-146b-4b97-8f92-5df620163e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:51.111299 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ac2ef7b-146b-4b97-8f92-5df620163e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:51.112134 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ac2ef7b-146b-4b97-8f92-5df620163e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:51.113482 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ac2ef7b-146b-4b97-8f92-5df620163e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:51.353042 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-4ac2ef7b-146b-4b97-8f92-5df620163e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:51.365354 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4ac2ef7b-146b-4b97-8f92-5df620163e6f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.279299 Sep 26 18:04:51.376531 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 89/164] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:51 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:52.396210 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-0960536c-7a05-40fa-bd09-47550fb4ebde tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:52.398188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-0960536c-7a05-40fa-bd09-47550fb4ebde tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:52.407498 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0960536c-7a05-40fa-bd09-47550fb4ebde tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:52.408289 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0960536c-7a05-40fa-bd09-47550fb4ebde tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:52.409312 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0960536c-7a05-40fa-bd09-47550fb4ebde tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:52.410645 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0960536c-7a05-40fa-bd09-47550fb4ebde tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:52.411957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0960536c-7a05-40fa-bd09-47550fb4ebde tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:52.411957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0960536c-7a05-40fa-bd09-47550fb4ebde tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:52.652320 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-0960536c-7a05-40fa-bd09-47550fb4ebde tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:52.668089 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-0960536c-7a05-40fa-bd09-47550fb4ebde tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.276718 Sep 26 18:04:52.669187 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 76/165] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:52 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:53.697698 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d6a0df50-3723-4988-ba6c-776dd6bc3e00 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:53.698564 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d6a0df50-3723-4988-ba6c-776dd6bc3e00 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:53.711989 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d6a0df50-3723-4988-ba6c-776dd6bc3e00 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:53.711989 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d6a0df50-3723-4988-ba6c-776dd6bc3e00 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:53.711989 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d6a0df50-3723-4988-ba6c-776dd6bc3e00 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:53.713429 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d6a0df50-3723-4988-ba6c-776dd6bc3e00 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:53.714389 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d6a0df50-3723-4988-ba6c-776dd6bc3e00 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:53.715196 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d6a0df50-3723-4988-ba6c-776dd6bc3e00 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:53.959840 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d6a0df50-3723-4988-ba6c-776dd6bc3e00 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:53.964586 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d6a0df50-3723-4988-ba6c-776dd6bc3e00 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.274634 Sep 26 18:04:53.965210 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 90/166] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:53 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:54.994748 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f55cbb14-29ff-4949-b175-a86c075d50ff tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:54.996865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f55cbb14-29ff-4949-b175-a86c075d50ff tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:55.010539 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f55cbb14-29ff-4949-b175-a86c075d50ff tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:55.011479 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f55cbb14-29ff-4949-b175-a86c075d50ff tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:55.012208 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f55cbb14-29ff-4949-b175-a86c075d50ff tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:55.013714 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f55cbb14-29ff-4949-b175-a86c075d50ff tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:55.014387 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f55cbb14-29ff-4949-b175-a86c075d50ff tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:55.014821 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f55cbb14-29ff-4949-b175-a86c075d50ff tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:55.250041 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f55cbb14-29ff-4949-b175-a86c075d50ff tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:55.264276 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f55cbb14-29ff-4949-b175-a86c075d50ff tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.275501 Sep 26 18:04:55.266041 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 77/167] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:54 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:04:56.295220 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ea3cd1c8-7d3c-431d-b251-a9167a14cca5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:56.300940 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ea3cd1c8-7d3c-431d-b251-a9167a14cca5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:56.311686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ea3cd1c8-7d3c-431d-b251-a9167a14cca5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:56.312524 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ea3cd1c8-7d3c-431d-b251-a9167a14cca5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:56.313252 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ea3cd1c8-7d3c-431d-b251-a9167a14cca5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:56.314858 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ea3cd1c8-7d3c-431d-b251-a9167a14cca5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:56.316686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ea3cd1c8-7d3c-431d-b251-a9167a14cca5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:56.317746 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ea3cd1c8-7d3c-431d-b251-a9167a14cca5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:56.518022 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ea3cd1c8-7d3c-431d-b251-a9167a14cca5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:56.529862 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ea3cd1c8-7d3c-431d-b251-a9167a14cca5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.241098 Sep 26 18:04:56.530339 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 91/168] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:56 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:57.553581 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a8f740a4-b465-40f5-9a14-d21a07e9b373 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:57.554227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a8f740a4-b465-40f5-9a14-d21a07e9b373 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:57.579461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8f740a4-b465-40f5-9a14-d21a07e9b373 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:57.580270 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8f740a4-b465-40f5-9a14-d21a07e9b373 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:57.580962 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8f740a4-b465-40f5-9a14-d21a07e9b373 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:57.582379 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8f740a4-b465-40f5-9a14-d21a07e9b373 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:57.583220 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8f740a4-b465-40f5-9a14-d21a07e9b373 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:57.583823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8f740a4-b465-40f5-9a14-d21a07e9b373 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:57.781502 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a8f740a4-b465-40f5-9a14-d21a07e9b373 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:57.794781 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a8f740a4-b465-40f5-9a14-d21a07e9b373 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.246176 Sep 26 18:04:57.795391 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 78/169] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:57 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:58.190038 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2feacf1d-3d66-4e18-8e0f-89bbf1e8c535 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:58.193220 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2feacf1d-3d66-4e18-8e0f-89bbf1e8c535 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:58.202066 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2feacf1d-3d66-4e18-8e0f-89bbf1e8c535 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:58.203015 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2feacf1d-3d66-4e18-8e0f-89bbf1e8c535 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:58.203568 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2feacf1d-3d66-4e18-8e0f-89bbf1e8c535 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:58.204933 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2feacf1d-3d66-4e18-8e0f-89bbf1e8c535 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:58.205935 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2feacf1d-3d66-4e18-8e0f-89bbf1e8c535 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:58.207742 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2feacf1d-3d66-4e18-8e0f-89bbf1e8c535 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:58.245051 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2feacf1d-3d66-4e18-8e0f-89bbf1e8c535 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Going to try to terminate instance {{(pid=121028) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:04:58.836773 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e0340eab-2636-43d0-82f6-970cadd53b4c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:58.837655 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e0340eab-2636-43d0-82f6-970cadd53b4c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:58.846068 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0340eab-2636-43d0-82f6-970cadd53b4c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:58.846576 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0340eab-2636-43d0-82f6-970cadd53b4c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:58.848748 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0340eab-2636-43d0-82f6-970cadd53b4c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:58.850070 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0340eab-2636-43d0-82f6-970cadd53b4c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:58.850664 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0340eab-2636-43d0-82f6-970cadd53b4c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:58.861905 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0340eab-2636-43d0-82f6-970cadd53b4c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:59.010794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e0340eab-2636-43d0-82f6-970cadd53b4c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:59.015237 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e0340eab-2636-43d0-82f6-970cadd53b4c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.184845 Sep 26 18:04:59.016159 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 79/170] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:58 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:04:59.199555 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2feacf1d-3d66-4e18-8e0f-89bbf1e8c535 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 204 len: 0 microversion: 2.1 time: 1.015508 Sep 26 18:04:59.200358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 92/171] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:04:58 2022] DELETE /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 0 bytes in 1017 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:04:59.208985 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-36fbb42d-c9f7-4c1f-ab83-893976c6b5c3 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:04:59.209611 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-36fbb42d-c9f7-4c1f-ab83-893976c6b5c3 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:04:59.218037 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-36fbb42d-c9f7-4c1f-ab83-893976c6b5c3 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:59.218037 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-36fbb42d-c9f7-4c1f-ab83-893976c6b5c3 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:59.223506 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-36fbb42d-c9f7-4c1f-ab83-893976c6b5c3 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:59.224654 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-36fbb42d-c9f7-4c1f-ab83-893976c6b5c3 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:04:59.225637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-36fbb42d-c9f7-4c1f-ab83-893976c6b5c3 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:04:59.226144 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-36fbb42d-c9f7-4c1f-ab83-893976c6b5c3 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:04:59.453780 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-36fbb42d-c9f7-4c1f-ab83-893976c6b5c3 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:04:59.470327 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-36fbb42d-c9f7-4c1f-ab83-893976c6b5c3 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1552 microversion: 2.1 time: 0.265390 Sep 26 18:04:59.472753 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 80/172] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:04:59 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1552 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:00.040012 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b4069a7f-3b23-4691-85ad-4b679b1e2efd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:00.040781 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b4069a7f-3b23-4691-85ad-4b679b1e2efd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:00.042679 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:00.048891 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4069a7f-3b23-4691-85ad-4b679b1e2efd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:00.049383 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4069a7f-3b23-4691-85ad-4b679b1e2efd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:00.050544 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4069a7f-3b23-4691-85ad-4b679b1e2efd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:00.051365 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4069a7f-3b23-4691-85ad-4b679b1e2efd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:00.051855 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4069a7f-3b23-4691-85ad-4b679b1e2efd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:00.052287 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4069a7f-3b23-4691-85ad-4b679b1e2efd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:00.465470 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b4069a7f-3b23-4691-85ad-4b679b1e2efd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:00.478431 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b4069a7f-3b23-4691-85ad-4b679b1e2efd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.442618 Sep 26 18:05:00.479236 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 93/173] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:00 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:00.504674 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-882a88b1-e33d-4ba3-9528-d7a23cd5d90a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:00.510151 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-882a88b1-e33d-4ba3-9528-d7a23cd5d90a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:00.513283 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-882a88b1-e33d-4ba3-9528-d7a23cd5d90a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:00.513911 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-882a88b1-e33d-4ba3-9528-d7a23cd5d90a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:00.514614 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-882a88b1-e33d-4ba3-9528-d7a23cd5d90a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:00.515415 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-882a88b1-e33d-4ba3-9528-d7a23cd5d90a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:00.516252 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-882a88b1-e33d-4ba3-9528-d7a23cd5d90a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:00.516899 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-882a88b1-e33d-4ba3-9528-d7a23cd5d90a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:00.716179 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-882a88b1-e33d-4ba3-9528-d7a23cd5d90a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:00.731303 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-882a88b1-e33d-4ba3-9528-d7a23cd5d90a tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1552 microversion: 2.1 time: 0.230961 Sep 26 18:05:00.732532 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 81/174] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:00 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1552 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:01.510915 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-7572fed3-2afb-4d34-b469-389d150fa5e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:01.513221 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-7572fed3-2afb-4d34-b469-389d150fa5e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:01.523879 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7572fed3-2afb-4d34-b469-389d150fa5e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:01.524572 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7572fed3-2afb-4d34-b469-389d150fa5e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:01.525165 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7572fed3-2afb-4d34-b469-389d150fa5e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:01.526828 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7572fed3-2afb-4d34-b469-389d150fa5e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:01.527480 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7572fed3-2afb-4d34-b469-389d150fa5e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:01.528568 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7572fed3-2afb-4d34-b469-389d150fa5e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:01.697510 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-7572fed3-2afb-4d34-b469-389d150fa5e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:01.705699 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-7572fed3-2afb-4d34-b469-389d150fa5e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.200814 Sep 26 18:05:01.707105 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 94/175] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:01 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:01.771757 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-904bd42e-3176-4f78-a5f3-7535617dee81 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:01.773192 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-904bd42e-3176-4f78-a5f3-7535617dee81 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:01.780172 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-904bd42e-3176-4f78-a5f3-7535617dee81 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:01.780884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-904bd42e-3176-4f78-a5f3-7535617dee81 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:01.781510 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-904bd42e-3176-4f78-a5f3-7535617dee81 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:01.782387 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-904bd42e-3176-4f78-a5f3-7535617dee81 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:01.783181 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-904bd42e-3176-4f78-a5f3-7535617dee81 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:01.783807 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-904bd42e-3176-4f78-a5f3-7535617dee81 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:01.972470 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-904bd42e-3176-4f78-a5f3-7535617dee81 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:01.974371 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-904bd42e-3176-4f78-a5f3-7535617dee81 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1552 microversion: 2.1 time: 0.208607 Sep 26 18:05:01.975067 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 82/176] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:01 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1552 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:02.743837 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e9ef7c19-d450-4301-bf4d-adff2f732f64 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:02.744449 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e9ef7c19-d450-4301-bf4d-adff2f732f64 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:02.758239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e9ef7c19-d450-4301-bf4d-adff2f732f64 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:02.759003 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e9ef7c19-d450-4301-bf4d-adff2f732f64 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:02.760319 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e9ef7c19-d450-4301-bf4d-adff2f732f64 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:02.763428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e9ef7c19-d450-4301-bf4d-adff2f732f64 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:02.764555 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e9ef7c19-d450-4301-bf4d-adff2f732f64 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:02.766425 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e9ef7c19-d450-4301-bf4d-adff2f732f64 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:03.008602 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-560d3e93-4a21-449f-9e4c-02ec26267c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:03.010972 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-560d3e93-4a21-449f-9e4c-02ec26267c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:03.019754 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=32 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:03.021661 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-560d3e93-4a21-449f-9e4c-02ec26267c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:03.022741 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-560d3e93-4a21-449f-9e4c-02ec26267c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:03.023379 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-560d3e93-4a21-449f-9e4c-02ec26267c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:03.024227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-560d3e93-4a21-449f-9e4c-02ec26267c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:03.024718 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-560d3e93-4a21-449f-9e4c-02ec26267c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:03.025261 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-560d3e93-4a21-449f-9e4c-02ec26267c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:03.211421 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e9ef7c19-d450-4301-bf4d-adff2f732f64 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:03.219534 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e9ef7c19-d450-4301-bf4d-adff2f732f64 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.482574 Sep 26 18:05:03.220199 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 95/177] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:02 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:03.267781 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-560d3e93-4a21-449f-9e4c-02ec26267c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:03.277034 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-560d3e93-4a21-449f-9e4c-02ec26267c0f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1552 microversion: 2.1 time: 0.277739 Sep 26 18:05:03.277849 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 83/178] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:02 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1552 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:03.649316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-7165739b-745f-42e9-88dd-456673ee452d req-6f09afad-fafa-4644-9a73-61d95e6a758f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d3e0a96-a5c5-43b1-97d6-172536258bc4", "name": "network-vif-deleted", "tag": "d0137809-e085-4d58-a7ea-c00ace0e5fb0"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:03.694323 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-7165739b-745f-42e9-88dd-456673ee452d req-6f09afad-fafa-4644-9a73-61d95e6a758f service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:03.696856 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-7165739b-745f-42e9-88dd-456673ee452d req-6f09afad-fafa-4644-9a73-61d95e6a758f service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:03.701550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-7165739b-745f-42e9-88dd-456673ee452d req-6f09afad-fafa-4644-9a73-61d95e6a758f service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:03.729938 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-7165739b-745f-42e9-88dd-456673ee452d req-6f09afad-fafa-4644-9a73-61d95e6a758f service nova] Creating event network-vif-deleted:d0137809-e085-4d58-a7ea-c00ace0e5fb0 for instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 on hv-cinder-85931 Sep 26 18:05:03.735529 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-7165739b-745f-42e9-88dd-456673ee452d req-6f09afad-fafa-4644-9a73-61d95e6a758f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095461 Sep 26 18:05:03.741511 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 96/179] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:05:04.246564 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5cfc7475-5c76-452f-922c-538cd2a2cc58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:04.247593 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-5cfc7475-5c76-452f-922c-538cd2a2cc58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:04.260672 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cfc7475-5c76-452f-922c-538cd2a2cc58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:04.261563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cfc7475-5c76-452f-922c-538cd2a2cc58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:04.262343 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cfc7475-5c76-452f-922c-538cd2a2cc58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:04.263611 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cfc7475-5c76-452f-922c-538cd2a2cc58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:04.264488 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cfc7475-5c76-452f-922c-538cd2a2cc58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:04.265225 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cfc7475-5c76-452f-922c-538cd2a2cc58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:04.301634 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d9d0208a-7c3d-4126-ad78-e1814df90f7f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:04.302628 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d9d0208a-7c3d-4126-ad78-e1814df90f7f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:04.310435 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9d0208a-7c3d-4126-ad78-e1814df90f7f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:04.311041 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9d0208a-7c3d-4126-ad78-e1814df90f7f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:04.311709 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9d0208a-7c3d-4126-ad78-e1814df90f7f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:04.312900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9d0208a-7c3d-4126-ad78-e1814df90f7f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:04.313390 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9d0208a-7c3d-4126-ad78-e1814df90f7f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:04.313814 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9d0208a-7c3d-4126-ad78-e1814df90f7f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:04.466986 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d9d0208a-7c3d-4126-ad78-e1814df90f7f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:04.486469 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d9d0208a-7c3d-4126-ad78-e1814df90f7f tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1345 microversion: 2.1 time: 0.188897 Sep 26 18:05:04.499197 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 97/180] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:04 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1345 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:04.539745 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5cfc7475-5c76-452f-922c-538cd2a2cc58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:04.555039 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5cfc7475-5c76-452f-922c-538cd2a2cc58 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.313702 Sep 26 18:05:04.556101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 84/181] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:04 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:05.535878 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-49c571ab-59ae-4b3c-b84e-7c0b03db4883 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:05.536534 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-49c571ab-59ae-4b3c-b84e-7c0b03db4883 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:05.545978 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49c571ab-59ae-4b3c-b84e-7c0b03db4883 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:05.546680 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49c571ab-59ae-4b3c-b84e-7c0b03db4883 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:05.547256 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49c571ab-59ae-4b3c-b84e-7c0b03db4883 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:05.548033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49c571ab-59ae-4b3c-b84e-7c0b03db4883 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:05.548780 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49c571ab-59ae-4b3c-b84e-7c0b03db4883 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:05.549183 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49c571ab-59ae-4b3c-b84e-7c0b03db4883 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:05.597648 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e7ecf30a-4883-4189-a135-7de315bd66a4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:05.598964 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e7ecf30a-4883-4189-a135-7de315bd66a4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:05.603891 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49c571ab-59ae-4b3c-b84e-7c0b03db4883 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:05.604661 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49c571ab-59ae-4b3c-b84e-7c0b03db4883 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:05.605408 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49c571ab-59ae-4b3c-b84e-7c0b03db4883 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:05.605577 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e7ecf30a-4883-4189-a135-7de315bd66a4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:05.605896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e7ecf30a-4883-4189-a135-7de315bd66a4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:05.606163 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-49c571ab-59ae-4b3c-b84e-7c0b03db4883 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lazy-loading 'fault' on Instance uuid 4d3e0a96-a5c5-43b1-97d6-172536258bc4 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:05:05.606360 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e7ecf30a-4883-4189-a135-7de315bd66a4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:05.607035 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e7ecf30a-4883-4189-a135-7de315bd66a4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:05.607489 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e7ecf30a-4883-4189-a135-7de315bd66a4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:05.607944 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e7ecf30a-4883-4189-a135-7de315bd66a4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:05.673349 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-49c571ab-59ae-4b3c-b84e-7c0b03db4883 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e51ac136874806b4b903235697b404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd6fe4cc3554b888bb25819f5fac1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:05.683252 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-49c571ab-59ae-4b3c-b84e-7c0b03db4883 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 200 len: 1350 microversion: 2.1 time: 0.151716 Sep 26 18:05:05.684042 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 98/182] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:05 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:05.835551 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e7ecf30a-4883-4189-a135-7de315bd66a4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:05.843702 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e7ecf30a-4883-4189-a135-7de315bd66a4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.253136 Sep 26 18:05:05.844325 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 85/183] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:05 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:06.722591 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-53e37e63-270b-40d2-87ab-cd627b5e6799 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:06.723997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-53e37e63-270b-40d2-87ab-cd627b5e6799 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:06.742812 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-53e37e63-270b-40d2-87ab-cd627b5e6799 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:06.743424 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-53e37e63-270b-40d2-87ab-cd627b5e6799 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:06.744011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-53e37e63-270b-40d2-87ab-cd627b5e6799 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:06.744945 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-53e37e63-270b-40d2-87ab-cd627b5e6799 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:06.745521 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-53e37e63-270b-40d2-87ab-cd627b5e6799 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:06.745983 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-53e37e63-270b-40d2-87ab-cd627b5e6799 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:06.765742 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-53e37e63-270b-40d2-87ab-cd627b5e6799 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] HTTP exception thrown: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-53e37e63-270b-40d2-87ab-cd627b5e6799 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Request method failure captured: Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 HTTP/1.1 Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMelw_W_jky34JdzulQUzRcScvUZI_9nksHMKe59zYEZGAy2cHOkGp2bDrAX2wj2sfVNRzm6ZkNLpdDNEvO5-vzoNeKVwqMdbbUJyQd5XQ6LgMdsy-Q_6Cvefe9fdrqkZ-hJ33I8Gd_MAs57JCLXjHvAMu0p4DJsgJGvIVdmGitaSgkA Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: bcd6fe4cc3554b888bb25819f5fac1e4 Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-DeleteServersTestJSON-1899306372 Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:05:06.771621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:05:06.772922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bcd6fe4cc3554b888bb25819f5fac1e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bcd6fe4cc3554b888bb25819f5fac1e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bcd6fe4cc3554b888bb25819f5fac1e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bcd6fe4cc3554b888bb25819f5fac1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:05:06.772922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-DeleteServersTestJSON-1899306372 Sep 26 18:05:06.772922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: bcd6fe4cc3554b888bb25819f5fac1e4 Sep 26 18:05:06.772922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-DeleteServersTestJSON-1899306372 Sep 26 18:05:06.772922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-DeleteServersTestJSON-1899306372-project Sep 26 18:05:06.772922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:05:06.772922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:05:06.772922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 14e51ac136874806b4b903235697b404 Sep 26 18:05:06.772922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-DeleteServersTestJSON-1899306372-project Sep 26 18:05:06.772922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:05:06.772922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:06.772922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '4d3e0a96-a5c5-43b1-97d6-172536258bc4'} Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:05:06.773613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:06.774876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:06.775909 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-53e37e63-270b-40d2-87ab-cd627b5e6799 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Returning 404 to user: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:05:06.775909 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-53e37e63-270b-40d2-87ab-cd627b5e6799 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 404 len: 111 microversion: 2.1 time: 0.056023 Sep 26 18:05:06.775909 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 99/184] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:06 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:05:06.869810 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1537654d-212f-47db-99e4-47f5a1b19d4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:06.870431 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1537654d-212f-47db-99e4-47f5a1b19d4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:06.879946 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1537654d-212f-47db-99e4-47f5a1b19d4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:06.880635 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1537654d-212f-47db-99e4-47f5a1b19d4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:06.881266 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1537654d-212f-47db-99e4-47f5a1b19d4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:06.882139 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1537654d-212f-47db-99e4-47f5a1b19d4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:06.882753 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1537654d-212f-47db-99e4-47f5a1b19d4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:06.883336 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1537654d-212f-47db-99e4-47f5a1b19d4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:06.939789 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4ddc3cf0-6c71-40b1-9476-edd6252c7b02 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:06.943778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4ddc3cf0-6c71-40b1-9476-edd6252c7b02 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:06.953483 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ddc3cf0-6c71-40b1-9476-edd6252c7b02 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:06.954450 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ddc3cf0-6c71-40b1-9476-edd6252c7b02 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:06.955191 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ddc3cf0-6c71-40b1-9476-edd6252c7b02 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:06.956720 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ddc3cf0-6c71-40b1-9476-edd6252c7b02 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:06.957673 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ddc3cf0-6c71-40b1-9476-edd6252c7b02 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:06.958375 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ddc3cf0-6c71-40b1-9476-edd6252c7b02 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:06.976343 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:06.978125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-4ddc3cf0-6c71-40b1-9476-edd6252c7b02 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] HTTP exception thrown: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4ddc3cf0-6c71-40b1-9476-edd6252c7b02 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Request method failure captured: Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4/os-volume_attachments HTTP/1.1 Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMelw_W_jky34JdzulQUzRcScvUZI_9nksHMKe59zYEZGAy2cHOkGp2bDrAX2wj2sfVNRzm6ZkNLpdDNEvO5-vzoNeKVwqMdbbUJyQd5XQ6LgMdsy-Q_6Cvefe9fdrqkZ-hJ33I8Gd_MAs57JCLXjHvAMu0p4DJsgJGvIVdmGitaSgkA Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: bcd6fe4cc3554b888bb25819f5fac1e4 Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-DeleteServersTestJSON-1899306372 Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:05:06.980541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:05:06.981897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bcd6fe4cc3554b888bb25819f5fac1e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bcd6fe4cc3554b888bb25819f5fac1e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bcd6fe4cc3554b888bb25819f5fac1e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bcd6fe4cc3554b888bb25819f5fac1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:05:06.981897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-DeleteServersTestJSON-1899306372 Sep 26 18:05:06.981897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: bcd6fe4cc3554b888bb25819f5fac1e4 Sep 26 18:05:06.981897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-DeleteServersTestJSON-1899306372 Sep 26 18:05:06.981897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-DeleteServersTestJSON-1899306372-project Sep 26 18:05:06.981897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:05:06.981897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:05:06.981897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 14e51ac136874806b4b903235697b404 Sep 26 18:05:06.981897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-DeleteServersTestJSON-1899306372-project Sep 26 18:05:06.981897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:05:06.981897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:06.981897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'server_id': '4d3e0a96-a5c5-43b1-97d6-172536258bc4'} Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:05:06.985542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:06.987613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:06.988831 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4ddc3cf0-6c71-40b1-9476-edd6252c7b02 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Returning 404 to user: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:05:06.988831 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4ddc3cf0-6c71-40b1-9476-edd6252c7b02 tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.048975 Sep 26 18:05:06.988831 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 100/185] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:05:06 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4/os-volume_attachments => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:05:07.092343 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1537654d-212f-47db-99e4-47f5a1b19d4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:07.112912 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1537654d-212f-47db-99e4-47f5a1b19d4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.247478 Sep 26 18:05:07.113533 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 86/186] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:06 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:08.144759 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-09c82c49-0716-4747-85c8-ad2b0771f7f9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:08.146021 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-09c82c49-0716-4747-85c8-ad2b0771f7f9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:08.153258 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-09c82c49-0716-4747-85c8-ad2b0771f7f9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:08.154084 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-09c82c49-0716-4747-85c8-ad2b0771f7f9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:08.154721 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-09c82c49-0716-4747-85c8-ad2b0771f7f9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:08.155489 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-09c82c49-0716-4747-85c8-ad2b0771f7f9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:08.156333 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-09c82c49-0716-4747-85c8-ad2b0771f7f9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:08.157197 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-09c82c49-0716-4747-85c8-ad2b0771f7f9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:08.331874 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-09c82c49-0716-4747-85c8-ad2b0771f7f9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:08.340995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-09c82c49-0716-4747-85c8-ad2b0771f7f9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.204269 Sep 26 18:05:08.341553 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 101/187] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:08 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:08.768219 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-af3fe5d2-f6a6-42da-b8a7-0d7e528380db tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:08.768882 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-af3fe5d2-f6a6-42da-b8a7-0d7e528380db tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:08.776298 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-af3fe5d2-f6a6-42da-b8a7-0d7e528380db tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:08.776912 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-af3fe5d2-f6a6-42da-b8a7-0d7e528380db tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:08.777452 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-af3fe5d2-f6a6-42da-b8a7-0d7e528380db tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:08.778264 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-af3fe5d2-f6a6-42da-b8a7-0d7e528380db tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:08.778883 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-af3fe5d2-f6a6-42da-b8a7-0d7e528380db tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:08.779415 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-af3fe5d2-f6a6-42da-b8a7-0d7e528380db tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:08.798537 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-602563907", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452", "networks": [{"uuid": "a142954b-43e8-41cf-b242-1c1db52c4d6c"}]}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:08.804523 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-af3fe5d2-f6a6-42da-b8a7-0d7e528380db tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] HTTP exception thrown: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-af3fe5d2-f6a6-42da-b8a7-0d7e528380db tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Request method failure captured: Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: DELETE /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 HTTP/1.1 Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMelw_W_jky34JdzulQUzRcScvUZI_9nksHMKe59zYEZGAy2cHOkGp2bDrAX2wj2sfVNRzm6ZkNLpdDNEvO5-vzoNeKVwqMdbbUJyQd5XQ6LgMdsy-Q_6Cvefe9fdrqkZ-hJ33I8Gd_MAs57JCLXjHvAMu0p4DJsgJGvIVdmGitaSgkA Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: bcd6fe4cc3554b888bb25819f5fac1e4 Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-DeleteServersTestJSON-1899306372 Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:05:08.813705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:05:08.816461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bcd6fe4cc3554b888bb25819f5fac1e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bcd6fe4cc3554b888bb25819f5fac1e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bcd6fe4cc3554b888bb25819f5fac1e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bcd6fe4cc3554b888bb25819f5fac1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:05:08.816461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-DeleteServersTestJSON-1899306372 Sep 26 18:05:08.816461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: bcd6fe4cc3554b888bb25819f5fac1e4 Sep 26 18:05:08.816461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-DeleteServersTestJSON-1899306372 Sep 26 18:05:08.816461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-DeleteServersTestJSON-1899306372-project Sep 26 18:05:08.816461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:05:08.816461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:05:08.816461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 14e51ac136874806b4b903235697b404 Sep 26 18:05:08.816461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-DeleteServersTestJSON-1899306372-project Sep 26 18:05:08.816461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:05:08.816461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:08.816461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': '4d3e0a96-a5c5-43b1-97d6-172536258bc4'} Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:05:08.817104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:08.818176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:05:08.819313 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-af3fe5d2-f6a6-42da-b8a7-0d7e528380db tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Returning 404 to user: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:05:08.819313 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-af3fe5d2-f6a6-42da-b8a7-0d7e528380db tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 404 len: 111 microversion: 2.1 time: 0.056774 Sep 26 18:05:08.820695 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 87/188] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:05:08 2022] DELETE /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:05:08.831203 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-631c7ecf-6343-4ec3-a2a9-711a7cb9a64b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:08.832021 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-631c7ecf-6343-4ec3-a2a9-711a7cb9a64b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] [instance: 4d3e0a96-a5c5-43b1-97d6-172536258bc4] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:08.838560 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-631c7ecf-6343-4ec3-a2a9-711a7cb9a64b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:08.839049 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-631c7ecf-6343-4ec3-a2a9-711a7cb9a64b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:08.839467 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-631c7ecf-6343-4ec3-a2a9-711a7cb9a64b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:08.840176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-631c7ecf-6343-4ec3-a2a9-711a7cb9a64b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:08.840634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-631c7ecf-6343-4ec3-a2a9-711a7cb9a64b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:08.841050 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-631c7ecf-6343-4ec3-a2a9-711a7cb9a64b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:08.878127 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-631c7ecf-6343-4ec3-a2a9-711a7cb9a64b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] HTTP exception thrown: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-631c7ecf-6343-4ec3-a2a9-711a7cb9a64b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Request method failure captured: Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 HTTP/1.1 Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMelw_W_jky34JdzulQUzRcScvUZI_9nksHMKe59zYEZGAy2cHOkGp2bDrAX2wj2sfVNRzm6ZkNLpdDNEvO5-vzoNeKVwqMdbbUJyQd5XQ6LgMdsy-Q_6Cvefe9fdrqkZ-hJ33I8Gd_MAs57JCLXjHvAMu0p4DJsgJGvIVdmGitaSgkA Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: bcd6fe4cc3554b888bb25819f5fac1e4 Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-DeleteServersTestJSON-1899306372 Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:05:08.880876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:05:08.882563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bcd6fe4cc3554b888bb25819f5fac1e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bcd6fe4cc3554b888bb25819f5fac1e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bcd6fe4cc3554b888bb25819f5fac1e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bcd6fe4cc3554b888bb25819f5fac1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:05:08.882563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-DeleteServersTestJSON-1899306372 Sep 26 18:05:08.882563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: bcd6fe4cc3554b888bb25819f5fac1e4 Sep 26 18:05:08.882563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-DeleteServersTestJSON-1899306372 Sep 26 18:05:08.882563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-DeleteServersTestJSON-1899306372-project Sep 26 18:05:08.882563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:05:08.882563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:05:08.882563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 14e51ac136874806b4b903235697b404 Sep 26 18:05:08.882563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-DeleteServersTestJSON-1899306372-project Sep 26 18:05:08.882563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:05:08.882563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:08.882563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': '4d3e0a96-a5c5-43b1-97d6-172536258bc4'} Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:05:08.884007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. Sep 26 18:05:08.885982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:05:08.890613 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-631c7ecf-6343-4ec3-a2a9-711a7cb9a64b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] Returning 404 to user: Instance 4d3e0a96-a5c5-43b1-97d6-172536258bc4 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:05:08.891238 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-631c7ecf-6343-4ec3-a2a9-711a7cb9a64b tempest-DeleteServersTestJSON-1899306372 tempest-DeleteServersTestJSON-1899306372-project] 10.222.0.67 "GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4" status: 404 len: 111 microversion: 2.1 time: 0.065252 Sep 26 18:05:08.897078 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 88/189] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:08 2022] GET /compute/v2.1/servers/4d3e0a96-a5c5-43b1-97d6-172536258bc4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:05:08.897303 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.network.neutron [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] validate_networks() for [('a142954b-43e8-41cf-b242-1c1db52c4d6c', None, None, None, None, None)] {{(pid=121028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:05:09.376933 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-3491424c-809b-413a-943a-b570101ffd65 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:09.378290 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3491424c-809b-413a-943a-b570101ffd65 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:09.390179 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3491424c-809b-413a-943a-b570101ffd65 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:09.391249 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3491424c-809b-413a-943a-b570101ffd65 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:09.392161 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3491424c-809b-413a-943a-b570101ffd65 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:09.393591 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3491424c-809b-413a-943a-b570101ffd65 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:09.394510 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3491424c-809b-413a-943a-b570101ffd65 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:09.395402 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3491424c-809b-413a-943a-b570101ffd65 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:09.827079 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3491424c-809b-413a-943a-b570101ffd65 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:09.827079 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-3491424c-809b-413a-943a-b570101ffd65 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.419250 Sep 26 18:05:09.827079 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 89/190] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:09 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:09.857346 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Flavor limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:05:09.858421 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Image limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:05:09.859130 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Flavor pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:05:09.859759 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Image pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:05:09.860454 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:05:09.873831 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:09.878465 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:09.878465 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:09.878465 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:09.879082 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:09.880022 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:09.902214 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Getting quotas for project 31e42dd8f6ff445cb7d44b0b0ce94fc2. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:05:09.910371 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Getting quotas for user 349bc0a30f324816804e596c937e3da0 and project 31e42dd8f6ff445cb7d44b0b0ce94fc2. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:05:09.925262 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Going to run 1 instances... {{(pid=121028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:05:09.929434 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:05:10.170709 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9a7a70af-3001-4e25-a43b-10cdd6462499 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.378266 Sep 26 18:05:10.171582 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 102/191] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:05:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:05:10.189402 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-850f22cc-337f-41b1-b1ce-0ecee21da7d6 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:10.190926 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-850f22cc-337f-41b1-b1ce-0ecee21da7d6 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:10.418455 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-850f22cc-337f-41b1-b1ce-0ecee21da7d6 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:10.442377 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-850f22cc-337f-41b1-b1ce-0ecee21da7d6 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1213 microversion: 2.1 time: 0.257103 Sep 26 18:05:10.445757 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 90/192] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:10 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1213 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:10.856484 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1ab2fe6b-6017-4f4d-b6d4-88658fce5a5d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:10.857581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1ab2fe6b-6017-4f4d-b6d4-88658fce5a5d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:10.869320 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1ab2fe6b-6017-4f4d-b6d4-88658fce5a5d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:10.869894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1ab2fe6b-6017-4f4d-b6d4-88658fce5a5d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:10.871453 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1ab2fe6b-6017-4f4d-b6d4-88658fce5a5d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:10.872657 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1ab2fe6b-6017-4f4d-b6d4-88658fce5a5d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:10.873390 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1ab2fe6b-6017-4f4d-b6d4-88658fce5a5d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:10.874915 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1ab2fe6b-6017-4f4d-b6d4-88658fce5a5d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:11.132454 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1ab2fe6b-6017-4f4d-b6d4-88658fce5a5d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:11.151503 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1ab2fe6b-6017-4f4d-b6d4-88658fce5a5d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.301700 Sep 26 18:05:11.152138 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 103/193] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:10 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:11.492348 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5a361a2a-ea49-48d2-82e1-0ea77591701e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:11.493509 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-5a361a2a-ea49-48d2-82e1-0ea77591701e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:11.604965 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5a361a2a-ea49-48d2-82e1-0ea77591701e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:11.628822 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5a361a2a-ea49-48d2-82e1-0ea77591701e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1213 microversion: 2.1 time: 0.143242 Sep 26 18:05:11.630800 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 91/194] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:11 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:12.187325 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-32763400-b8e3-436a-b20e-6ea5a0fdc81a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:12.188257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-32763400-b8e3-436a-b20e-6ea5a0fdc81a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:12.202552 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-32763400-b8e3-436a-b20e-6ea5a0fdc81a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:12.203833 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-32763400-b8e3-436a-b20e-6ea5a0fdc81a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:12.204863 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-32763400-b8e3-436a-b20e-6ea5a0fdc81a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:12.206490 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-32763400-b8e3-436a-b20e-6ea5a0fdc81a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:12.207333 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-32763400-b8e3-436a-b20e-6ea5a0fdc81a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:12.209861 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-32763400-b8e3-436a-b20e-6ea5a0fdc81a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:12.551392 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-32763400-b8e3-436a-b20e-6ea5a0fdc81a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:12.568759 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-32763400-b8e3-436a-b20e-6ea5a0fdc81a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1520 microversion: 2.1 time: 0.388070 Sep 26 18:05:12.569372 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 104/195] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:12 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1520 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:12.663159 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-2effabf3-e6a0-449d-a2c5-8dcd6b40f2ae tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:12.664026 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-2effabf3-e6a0-449d-a2c5-8dcd6b40f2ae tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:12.673575 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2effabf3-e6a0-449d-a2c5-8dcd6b40f2ae tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:12.675341 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2effabf3-e6a0-449d-a2c5-8dcd6b40f2ae tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:12.676504 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2effabf3-e6a0-449d-a2c5-8dcd6b40f2ae tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:12.677991 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2effabf3-e6a0-449d-a2c5-8dcd6b40f2ae tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:12.679162 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2effabf3-e6a0-449d-a2c5-8dcd6b40f2ae tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:12.683908 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2effabf3-e6a0-449d-a2c5-8dcd6b40f2ae tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:12.768702 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-2effabf3-e6a0-449d-a2c5-8dcd6b40f2ae tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:12.778741 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-2effabf3-e6a0-449d-a2c5-8dcd6b40f2ae tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1217 microversion: 2.1 time: 0.120749 Sep 26 18:05:12.779762 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 92/196] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:12 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:13.603822 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-14d84648-f99f-4f6a-a900-47c5909f11a3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:13.605845 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-14d84648-f99f-4f6a-a900-47c5909f11a3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:13.637620 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-14d84648-f99f-4f6a-a900-47c5909f11a3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:13.640603 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-14d84648-f99f-4f6a-a900-47c5909f11a3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:13.645302 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-14d84648-f99f-4f6a-a900-47c5909f11a3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:13.650806 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-14d84648-f99f-4f6a-a900-47c5909f11a3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:13.655892 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-14d84648-f99f-4f6a-a900-47c5909f11a3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:13.656743 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-14d84648-f99f-4f6a-a900-47c5909f11a3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:13.857223 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ff32b775-6fb6-4d14-bcbb-4a59cd521dc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:13.863359 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ff32b775-6fb6-4d14-bcbb-4a59cd521dc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:13.893541 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ff32b775-6fb6-4d14-bcbb-4a59cd521dc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:13.898987 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ff32b775-6fb6-4d14-bcbb-4a59cd521dc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:13.904730 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ff32b775-6fb6-4d14-bcbb-4a59cd521dc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:13.904730 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ff32b775-6fb6-4d14-bcbb-4a59cd521dc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:13.907231 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ff32b775-6fb6-4d14-bcbb-4a59cd521dc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:13.910073 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ff32b775-6fb6-4d14-bcbb-4a59cd521dc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:14.213704 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ff32b775-6fb6-4d14-bcbb-4a59cd521dc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:14.218424 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=100 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:14.227300 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ff32b775-6fb6-4d14-bcbb-4a59cd521dc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1209 microversion: 2.1 time: 0.416010 Sep 26 18:05:14.248322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 93/197] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:13 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1209 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:14.332289 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-14d84648-f99f-4f6a-a900-47c5909f11a3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:14.369955 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-14d84648-f99f-4f6a-a900-47c5909f11a3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1500 microversion: 2.1 time: 0.771041 Sep 26 18:05:14.371050 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 105/198] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:13 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1500 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:14.420861 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-004102a6-9164-46d9-9436-927c5e6eb1e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:14.423778 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-004102a6-9164-46d9-9436-927c5e6eb1e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:14.435944 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-004102a6-9164-46d9-9436-927c5e6eb1e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:14.437718 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-004102a6-9164-46d9-9436-927c5e6eb1e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:14.439241 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-004102a6-9164-46d9-9436-927c5e6eb1e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:14.441961 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-004102a6-9164-46d9-9436-927c5e6eb1e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:14.443029 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-004102a6-9164-46d9-9436-927c5e6eb1e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:14.453289 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-004102a6-9164-46d9-9436-927c5e6eb1e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:14.715637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-004102a6-9164-46d9-9436-927c5e6eb1e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:14.738202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-004102a6-9164-46d9-9436-927c5e6eb1e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1514 microversion: 2.1 time: 0.324972 Sep 26 18:05:14.768894 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 94/199] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:14 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1514 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:15.265554 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1bc30670-9ce7-4029-bdb4-42e6f565e549 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:15.268654 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1bc30670-9ce7-4029-bdb4-42e6f565e549 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:15.296275 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1bc30670-9ce7-4029-bdb4-42e6f565e549 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:15.296758 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1bc30670-9ce7-4029-bdb4-42e6f565e549 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:15.298067 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1bc30670-9ce7-4029-bdb4-42e6f565e549 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:15.299072 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1bc30670-9ce7-4029-bdb4-42e6f565e549 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:15.301017 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1bc30670-9ce7-4029-bdb4-42e6f565e549 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:15.301704 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1bc30670-9ce7-4029-bdb4-42e6f565e549 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:15.427318 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1bc30670-9ce7-4029-bdb4-42e6f565e549 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:15.439685 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1bc30670-9ce7-4029-bdb4-42e6f565e549 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1265 microversion: 2.1 time: 0.181618 Sep 26 18:05:15.442553 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 106/200] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:15 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:16.493710 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9cbfc893-ecaa-41f3-984f-8dfb9a837fc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:16.501256 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9cbfc893-ecaa-41f3-984f-8dfb9a837fc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:16.509133 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9cbfc893-ecaa-41f3-984f-8dfb9a837fc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:16.510144 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9cbfc893-ecaa-41f3-984f-8dfb9a837fc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:16.513726 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9cbfc893-ecaa-41f3-984f-8dfb9a837fc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:16.514543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9cbfc893-ecaa-41f3-984f-8dfb9a837fc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:16.515330 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9cbfc893-ecaa-41f3-984f-8dfb9a837fc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:16.515476 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9cbfc893-ecaa-41f3-984f-8dfb9a837fc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:16.682690 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9cbfc893-ecaa-41f3-984f-8dfb9a837fc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:16.707366 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9cbfc893-ecaa-41f3-984f-8dfb9a837fc2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1283 microversion: 2.1 time: 0.208454 Sep 26 18:05:16.707366 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 95/201] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:16 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1283 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:17.727913 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-044e1001-6cf2-4402-b7ee-10e01fa4df96 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:17.728898 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-044e1001-6cf2-4402-b7ee-10e01fa4df96 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:17.747227 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-044e1001-6cf2-4402-b7ee-10e01fa4df96 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:17.753576 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-044e1001-6cf2-4402-b7ee-10e01fa4df96 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:17.753576 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-044e1001-6cf2-4402-b7ee-10e01fa4df96 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:17.753576 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-044e1001-6cf2-4402-b7ee-10e01fa4df96 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:17.753576 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-044e1001-6cf2-4402-b7ee-10e01fa4df96 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:17.760562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-044e1001-6cf2-4402-b7ee-10e01fa4df96 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:17.906373 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f6367763-aaf9-41e1-8d2d-68f4747a45ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:17.909676 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f6367763-aaf9-41e1-8d2d-68f4747a45ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:17.917405 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f6367763-aaf9-41e1-8d2d-68f4747a45ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:17.918166 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f6367763-aaf9-41e1-8d2d-68f4747a45ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:17.919099 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f6367763-aaf9-41e1-8d2d-68f4747a45ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:17.920111 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f6367763-aaf9-41e1-8d2d-68f4747a45ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:17.920775 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f6367763-aaf9-41e1-8d2d-68f4747a45ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:17.921400 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f6367763-aaf9-41e1-8d2d-68f4747a45ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:17.961954 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-f6367763-aaf9-41e1-8d2d-68f4747a45ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lazy-loading 'flavor' on Instance uuid f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:05:18.104918 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-044e1001-6cf2-4402-b7ee-10e01fa4df96 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:18.116740 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-044e1001-6cf2-4402-b7ee-10e01fa4df96 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1313 microversion: 2.1 time: 0.395362 Sep 26 18:05:18.131545 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 107/202] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:17 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:18.656409 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f6367763-aaf9-41e1-8d2d-68f4747a45ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "POST /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9/action" status: 200 len: 32 microversion: 2.1 time: 0.753665 Sep 26 18:05:18.658431 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 96/203] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Sep 26 18:05:17 2022] POST /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9/action => generated 32 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 26 18:05:18.670525 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6f4c0259-4730-4399-af40-a23e084fcb55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:18.671782 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-6f4c0259-4730-4399-af40-a23e084fcb55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:18.684435 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6f4c0259-4730-4399-af40-a23e084fcb55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:18.685122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6f4c0259-4730-4399-af40-a23e084fcb55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:18.692632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6f4c0259-4730-4399-af40-a23e084fcb55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:18.693634 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6f4c0259-4730-4399-af40-a23e084fcb55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:18.694125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6f4c0259-4730-4399-af40-a23e084fcb55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:18.694554 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6f4c0259-4730-4399-af40-a23e084fcb55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:19.146928 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-2e9f2a47-4d58-4d5a-9506-68020d62b4d7 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:19.149488 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-2e9f2a47-4d58-4d5a-9506-68020d62b4d7 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:19.165653 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2e9f2a47-4d58-4d5a-9506-68020d62b4d7 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:19.166981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2e9f2a47-4d58-4d5a-9506-68020d62b4d7 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:19.167681 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2e9f2a47-4d58-4d5a-9506-68020d62b4d7 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:19.168759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2e9f2a47-4d58-4d5a-9506-68020d62b4d7 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:19.169507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2e9f2a47-4d58-4d5a-9506-68020d62b4d7 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:19.170140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2e9f2a47-4d58-4d5a-9506-68020d62b4d7 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:19.369401 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6f4c0259-4730-4399-af40-a23e084fcb55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:19.382291 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-6f4c0259-4730-4399-af40-a23e084fcb55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.717129 Sep 26 18:05:19.382945 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 108/204] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:18 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:19.393762 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-364247027", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452"}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:19.450338 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.network.neutron [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] validate_networks() for None {{(pid=121028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:05:19.742743 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-2e9f2a47-4d58-4d5a-9506-68020d62b4d7 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:19.750937 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-2e9f2a47-4d58-4d5a-9506-68020d62b4d7 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1313 microversion: 2.1 time: 0.610592 Sep 26 18:05:19.751726 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 97/205] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:19 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1313 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:19.889129 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=2 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:19.916460 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=6 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:20.062945 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Flavor limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:05:20.063594 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Image limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:05:20.064312 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Flavor pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:05:20.065615 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Image pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:05:20.066046 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:05:20.080188 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:20.081175 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:20.082232 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:20.083590 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:20.084856 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:20.086300 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:20.119545 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Getting quotas for project dee85100e2744253bece8a0d74c79f41. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:05:20.125628 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Getting quotas for user 046e50a17a6a4783895782d3aa2172e2 and project dee85100e2744253bece8a0d74c79f41. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:05:20.152981 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Going to run 1 instances... {{(pid=121028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:05:20.156223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:05:20.227543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-db413bd0-2830-44a6-93df-310c75b292ce req-a34407d0-0914-44cc-b947-c827cf159aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3f7652f-6765-4967-9ff6-f112a4b367e9", "tag": "c786b600-af8e-47b7-8eb2-2b3abde7c6a6"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:20.232072 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-db413bd0-2830-44a6-93df-310c75b292ce req-a34407d0-0914-44cc-b947-c827cf159aa1 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:20.232473 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-db413bd0-2830-44a6-93df-310c75b292ce req-a34407d0-0914-44cc-b947-c827cf159aa1 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:20.232939 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-db413bd0-2830-44a6-93df-310c75b292ce req-a34407d0-0914-44cc-b947-c827cf159aa1 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:20.246234 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-db413bd0-2830-44a6-93df-310c75b292ce req-a34407d0-0914-44cc-b947-c827cf159aa1 service nova] Creating event network-changed:c786b600-af8e-47b7-8eb2-2b3abde7c6a6 for instance c3f7652f-6765-4967-9ff6-f112a4b367e9 on hv-cinder-85931 Sep 26 18:05:20.254227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-db413bd0-2830-44a6-93df-310c75b292ce req-a34407d0-0914-44cc-b947-c827cf159aa1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041287 Sep 26 18:05:20.255332 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 98/206] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:05:20.387476 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-0c514943-bcc8-40a4-bb8a-bd7658d98899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.002780 Sep 26 18:05:20.390137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 109/207] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:05:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:05:20.407595 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c3f43c13-a91d-4baa-9b09-d16bfdaa9de8 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:20.410710 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c3f43c13-a91d-4baa-9b09-d16bfdaa9de8 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:20.442777 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3f735211-d509-43cc-8528-eeee95530f70 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:20.446960 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-3f735211-d509-43cc-8528-eeee95530f70 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:20.461909 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3f735211-d509-43cc-8528-eeee95530f70 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:20.464152 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3f735211-d509-43cc-8528-eeee95530f70 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:20.465223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3f735211-d509-43cc-8528-eeee95530f70 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:20.466683 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3f735211-d509-43cc-8528-eeee95530f70 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:20.467731 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3f735211-d509-43cc-8528-eeee95530f70 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:20.469101 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3f735211-d509-43cc-8528-eeee95530f70 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:20.588820 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c3f43c13-a91d-4baa-9b09-d16bfdaa9de8 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:20.598123 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c3f43c13-a91d-4baa-9b09-d16bfdaa9de8 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1214 microversion: 2.1 time: 0.198338 Sep 26 18:05:20.599823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 99/208] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:20 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1214 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:20.732921 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3f735211-d509-43cc-8528-eeee95530f70 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:20.742814 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-3f735211-d509-43cc-8528-eeee95530f70 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.328826 Sep 26 18:05:20.743398 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 110/209] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:20 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:20.776413 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-89089486-f530-42fe-a52a-cdad17db958a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:20.777028 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-89089486-f530-42fe-a52a-cdad17db958a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:20.786190 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-89089486-f530-42fe-a52a-cdad17db958a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:20.786830 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-89089486-f530-42fe-a52a-cdad17db958a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:20.787272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-89089486-f530-42fe-a52a-cdad17db958a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:20.788058 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-89089486-f530-42fe-a52a-cdad17db958a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:20.788528 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-89089486-f530-42fe-a52a-cdad17db958a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:20.788956 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-89089486-f530-42fe-a52a-cdad17db958a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:21.030362 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-89089486-f530-42fe-a52a-cdad17db958a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:21.045442 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-89089486-f530-42fe-a52a-cdad17db958a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1313 microversion: 2.1 time: 0.272909 Sep 26 18:05:21.046335 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 100/210] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:20 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:21.628865 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-54d185d5-edf8-43dc-8b47-943ec3a83899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:21.629924 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-54d185d5-edf8-43dc-8b47-943ec3a83899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:21.694789 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-54d185d5-edf8-43dc-8b47-943ec3a83899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:21.702007 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-54d185d5-edf8-43dc-8b47-943ec3a83899 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1214 microversion: 2.1 time: 0.081875 Sep 26 18:05:21.703743 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 111/211] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:21 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:21.772518 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e0d7d4f8-c71c-4862-a71a-eb1b0519c77c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:21.773577 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e0d7d4f8-c71c-4862-a71a-eb1b0519c77c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:21.785943 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0d7d4f8-c71c-4862-a71a-eb1b0519c77c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:21.786762 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0d7d4f8-c71c-4862-a71a-eb1b0519c77c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:21.787481 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0d7d4f8-c71c-4862-a71a-eb1b0519c77c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:21.788627 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0d7d4f8-c71c-4862-a71a-eb1b0519c77c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:21.789394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0d7d4f8-c71c-4862-a71a-eb1b0519c77c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:21.790055 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0d7d4f8-c71c-4862-a71a-eb1b0519c77c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:21.996830 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e0d7d4f8-c71c-4862-a71a-eb1b0519c77c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:22.014102 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e0d7d4f8-c71c-4862-a71a-eb1b0519c77c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.249566 Sep 26 18:05:22.015409 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 101/212] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:21 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:22.073393 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-15c8e2e5-3bbb-407c-b1cb-763b0bdbf579 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:22.074293 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-15c8e2e5-3bbb-407c-b1cb-763b0bdbf579 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:22.085317 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15c8e2e5-3bbb-407c-b1cb-763b0bdbf579 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:22.090295 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15c8e2e5-3bbb-407c-b1cb-763b0bdbf579 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:22.090295 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15c8e2e5-3bbb-407c-b1cb-763b0bdbf579 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:22.090295 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15c8e2e5-3bbb-407c-b1cb-763b0bdbf579 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:22.090295 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15c8e2e5-3bbb-407c-b1cb-763b0bdbf579 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:22.091386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15c8e2e5-3bbb-407c-b1cb-763b0bdbf579 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:22.280054 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-15c8e2e5-3bbb-407c-b1cb-763b0bdbf579 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:22.289482 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-15c8e2e5-3bbb-407c-b1cb-763b0bdbf579 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1313 microversion: 2.1 time: 0.221740 Sep 26 18:05:22.290130 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 112/213] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:22 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:22.732196 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1900dc36-7d38-40e1-a0f5-95d6714a97e1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:22.733150 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1900dc36-7d38-40e1-a0f5-95d6714a97e1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:22.745741 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1900dc36-7d38-40e1-a0f5-95d6714a97e1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:22.746239 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1900dc36-7d38-40e1-a0f5-95d6714a97e1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:22.746867 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1900dc36-7d38-40e1-a0f5-95d6714a97e1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:22.747844 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1900dc36-7d38-40e1-a0f5-95d6714a97e1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:22.748309 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1900dc36-7d38-40e1-a0f5-95d6714a97e1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:22.748731 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1900dc36-7d38-40e1-a0f5-95d6714a97e1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:22.821395 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1900dc36-7d38-40e1-a0f5-95d6714a97e1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:22.833655 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1900dc36-7d38-40e1-a0f5-95d6714a97e1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1218 microversion: 2.1 time: 0.106054 Sep 26 18:05:22.834217 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 102/214] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:22 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:23.065001 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-af8726c8-ae40-408f-a0b5-dc2dd93a3a7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:23.066099 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-af8726c8-ae40-408f-a0b5-dc2dd93a3a7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:23.078087 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af8726c8-ae40-408f-a0b5-dc2dd93a3a7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:23.078973 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af8726c8-ae40-408f-a0b5-dc2dd93a3a7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:23.080464 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af8726c8-ae40-408f-a0b5-dc2dd93a3a7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:23.081712 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af8726c8-ae40-408f-a0b5-dc2dd93a3a7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:23.082356 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af8726c8-ae40-408f-a0b5-dc2dd93a3a7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:23.082894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af8726c8-ae40-408f-a0b5-dc2dd93a3a7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:23.318872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d865506c-1e7a-4209-bcee-ce2231f5c708 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:23.319568 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d865506c-1e7a-4209-bcee-ce2231f5c708 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:23.325708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d865506c-1e7a-4209-bcee-ce2231f5c708 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:23.326186 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d865506c-1e7a-4209-bcee-ce2231f5c708 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:23.326624 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d865506c-1e7a-4209-bcee-ce2231f5c708 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:23.327689 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d865506c-1e7a-4209-bcee-ce2231f5c708 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:23.328300 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d865506c-1e7a-4209-bcee-ce2231f5c708 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:23.329381 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d865506c-1e7a-4209-bcee-ce2231f5c708 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:23.331036 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-af8726c8-ae40-408f-a0b5-dc2dd93a3a7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:23.338275 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-af8726c8-ae40-408f-a0b5-dc2dd93a3a7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.281939 Sep 26 18:05:23.338854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 113/215] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:23 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:23.473828 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d865506c-1e7a-4209-bcee-ce2231f5c708 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:23.482777 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d865506c-1e7a-4209-bcee-ce2231f5c708 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1313 microversion: 2.1 time: 0.171171 Sep 26 18:05:23.483365 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 103/216] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:23 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:23.862306 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-dec468fe-5039-4d97-ac50-a48547e4ebe1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:23.863965 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-dec468fe-5039-4d97-ac50-a48547e4ebe1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:23.874897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dec468fe-5039-4d97-ac50-a48547e4ebe1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:23.876152 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dec468fe-5039-4d97-ac50-a48547e4ebe1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:23.877509 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dec468fe-5039-4d97-ac50-a48547e4ebe1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:23.878815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dec468fe-5039-4d97-ac50-a48547e4ebe1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:23.879641 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dec468fe-5039-4d97-ac50-a48547e4ebe1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:23.880326 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dec468fe-5039-4d97-ac50-a48547e4ebe1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:24.009039 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-dec468fe-5039-4d97-ac50-a48547e4ebe1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:24.024177 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-dec468fe-5039-4d97-ac50-a48547e4ebe1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1218 microversion: 2.1 time: 0.169080 Sep 26 18:05:24.025376 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 114/217] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:23 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1218 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:24.380157 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c9871e5d-1827-46ed-949f-4999e80df12d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:24.381519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c9871e5d-1827-46ed-949f-4999e80df12d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:24.395122 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c9871e5d-1827-46ed-949f-4999e80df12d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:24.397218 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c9871e5d-1827-46ed-949f-4999e80df12d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:24.398960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c9871e5d-1827-46ed-949f-4999e80df12d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:24.400559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c9871e5d-1827-46ed-949f-4999e80df12d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:24.402045 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c9871e5d-1827-46ed-949f-4999e80df12d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:24.403157 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c9871e5d-1827-46ed-949f-4999e80df12d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:24.491842 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a2ab2fe0-7c2e-499e-a0de-fb3ebd290ede tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:24.492854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a2ab2fe0-7c2e-499e-a0de-fb3ebd290ede tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:24.506279 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a2ab2fe0-7c2e-499e-a0de-fb3ebd290ede tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:24.507544 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a2ab2fe0-7c2e-499e-a0de-fb3ebd290ede tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:24.508660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a2ab2fe0-7c2e-499e-a0de-fb3ebd290ede tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:24.510493 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a2ab2fe0-7c2e-499e-a0de-fb3ebd290ede tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:24.511449 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a2ab2fe0-7c2e-499e-a0de-fb3ebd290ede tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:24.512506 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a2ab2fe0-7c2e-499e-a0de-fb3ebd290ede tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:24.552380 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a2ab2fe0-7c2e-499e-a0de-fb3ebd290ede tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73/ips" status: 200 len: 149 microversion: 2.1 time: 0.068073 Sep 26 18:05:24.553086 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 115/218] 10.222.0.67 () {58 vars in 1248 bytes} [Mon Sep 26 18:05:24 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73/ips => generated 149 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:05:24.558694 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f2b6f83c-0703-411a-8856-6be4a0571e8b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:24.559724 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f2b6f83c-0703-411a-8856-6be4a0571e8b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:24.578434 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f2b6f83c-0703-411a-8856-6be4a0571e8b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:24.584687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f2b6f83c-0703-411a-8856-6be4a0571e8b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:24.584687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f2b6f83c-0703-411a-8856-6be4a0571e8b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:24.584687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f2b6f83c-0703-411a-8856-6be4a0571e8b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:24.584687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f2b6f83c-0703-411a-8856-6be4a0571e8b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:24.585687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f2b6f83c-0703-411a-8856-6be4a0571e8b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:24.743476 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c9871e5d-1827-46ed-949f-4999e80df12d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:24.761015 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c9871e5d-1827-46ed-949f-4999e80df12d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.390504 Sep 26 18:05:24.762258 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 104/219] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:24 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:25.067805 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-80e4eadc-26c4-4fb9-844d-a925dfc070a1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:25.069244 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-80e4eadc-26c4-4fb9-844d-a925dfc070a1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:25.081314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-80e4eadc-26c4-4fb9-844d-a925dfc070a1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:25.081834 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-80e4eadc-26c4-4fb9-844d-a925dfc070a1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:25.082283 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-80e4eadc-26c4-4fb9-844d-a925dfc070a1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:25.083097 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-80e4eadc-26c4-4fb9-844d-a925dfc070a1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:25.083786 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-80e4eadc-26c4-4fb9-844d-a925dfc070a1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:25.084458 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-80e4eadc-26c4-4fb9-844d-a925dfc070a1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:25.217923 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-80e4eadc-26c4-4fb9-844d-a925dfc070a1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:25.229045 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-80e4eadc-26c4-4fb9-844d-a925dfc070a1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1266 microversion: 2.1 time: 0.167261 Sep 26 18:05:25.229922 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 105/220] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:25 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:25.290555 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f2b6f83c-0703-411a-8856-6be4a0571e8b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:25.302292 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f2b6f83c-0703-411a-8856-6be4a0571e8b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1313 microversion: 2.1 time: 0.747888 Sep 26 18:05:25.303164 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 116/221] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:24 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1313 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:25.787757 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bbacf561-f87c-4dc4-b856-865e3739b917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:25.788258 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-bbacf561-f87c-4dc4-b856-865e3739b917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:25.815955 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbacf561-f87c-4dc4-b856-865e3739b917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:25.815955 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbacf561-f87c-4dc4-b856-865e3739b917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:25.816290 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbacf561-f87c-4dc4-b856-865e3739b917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:25.817936 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbacf561-f87c-4dc4-b856-865e3739b917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:25.817936 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbacf561-f87c-4dc4-b856-865e3739b917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:25.818129 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbacf561-f87c-4dc4-b856-865e3739b917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:26.000993 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bbacf561-f87c-4dc4-b856-865e3739b917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:26.010908 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bbacf561-f87c-4dc4-b856-865e3739b917 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.228289 Sep 26 18:05:26.011484 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 106/222] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:25 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:26.264659 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e957fd6c-8a7a-44a4-90c8-f1c4ee6b720c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:26.265285 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e957fd6c-8a7a-44a4-90c8-f1c4ee6b720c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:26.274780 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e957fd6c-8a7a-44a4-90c8-f1c4ee6b720c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:26.275362 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e957fd6c-8a7a-44a4-90c8-f1c4ee6b720c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:26.275869 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e957fd6c-8a7a-44a4-90c8-f1c4ee6b720c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:26.277256 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e957fd6c-8a7a-44a4-90c8-f1c4ee6b720c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:26.278383 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e957fd6c-8a7a-44a4-90c8-f1c4ee6b720c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:26.279468 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e957fd6c-8a7a-44a4-90c8-f1c4ee6b720c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:26.333536 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1f8260ab-78ef-46c5-b19c-36e0095610e4 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:26.334580 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1f8260ab-78ef-46c5-b19c-36e0095610e4 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:26.352087 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f8260ab-78ef-46c5-b19c-36e0095610e4 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:26.352869 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f8260ab-78ef-46c5-b19c-36e0095610e4 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:26.353745 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f8260ab-78ef-46c5-b19c-36e0095610e4 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:26.354733 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f8260ab-78ef-46c5-b19c-36e0095610e4 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:26.355352 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f8260ab-78ef-46c5-b19c-36e0095610e4 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:26.356018 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f8260ab-78ef-46c5-b19c-36e0095610e4 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:26.372615 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e957fd6c-8a7a-44a4-90c8-f1c4ee6b720c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:26.383704 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e957fd6c-8a7a-44a4-90c8-f1c4ee6b720c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1266 microversion: 2.1 time: 0.124566 Sep 26 18:05:26.384954 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 117/223] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:26 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:26.584589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1f8260ab-78ef-46c5-b19c-36e0095610e4 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:26.594825 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1f8260ab-78ef-46c5-b19c-36e0095610e4 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1313 microversion: 2.1 time: 0.268141 Sep 26 18:05:26.596428 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 107/224] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:26 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:27.044574 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-46119104-8a6e-4e3a-a1e8-f0cac412200c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:27.045563 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-46119104-8a6e-4e3a-a1e8-f0cac412200c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:27.054727 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-46119104-8a6e-4e3a-a1e8-f0cac412200c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:27.055332 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-46119104-8a6e-4e3a-a1e8-f0cac412200c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:27.056048 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-46119104-8a6e-4e3a-a1e8-f0cac412200c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:27.056767 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-46119104-8a6e-4e3a-a1e8-f0cac412200c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:27.057287 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-46119104-8a6e-4e3a-a1e8-f0cac412200c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:27.057870 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-46119104-8a6e-4e3a-a1e8-f0cac412200c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:27.325771 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-46119104-8a6e-4e3a-a1e8-f0cac412200c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:27.334992 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-46119104-8a6e-4e3a-a1e8-f0cac412200c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.294841 Sep 26 18:05:27.335584 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 118/225] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:27 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:27.417446 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-30ea7b8a-a8f5-4fef-bc80-ef2da7cd13d1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:27.418080 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-30ea7b8a-a8f5-4fef-bc80-ef2da7cd13d1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:27.432153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30ea7b8a-a8f5-4fef-bc80-ef2da7cd13d1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:27.432655 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30ea7b8a-a8f5-4fef-bc80-ef2da7cd13d1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:27.433163 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30ea7b8a-a8f5-4fef-bc80-ef2da7cd13d1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:27.435045 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30ea7b8a-a8f5-4fef-bc80-ef2da7cd13d1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:27.437504 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30ea7b8a-a8f5-4fef-bc80-ef2da7cd13d1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:27.438309 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30ea7b8a-a8f5-4fef-bc80-ef2da7cd13d1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:27.562546 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-30ea7b8a-a8f5-4fef-bc80-ef2da7cd13d1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:27.579922 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-30ea7b8a-a8f5-4fef-bc80-ef2da7cd13d1 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1274 microversion: 2.1 time: 0.167067 Sep 26 18:05:27.582086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 108/226] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:27 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1274 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:27.623803 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-494bc840-5acf-4777-af7d-0f658e3129e5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:27.626560 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-494bc840-5acf-4777-af7d-0f658e3129e5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:27.675073 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-494bc840-5acf-4777-af7d-0f658e3129e5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:27.675567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-494bc840-5acf-4777-af7d-0f658e3129e5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:27.685968 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-494bc840-5acf-4777-af7d-0f658e3129e5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:27.686996 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-494bc840-5acf-4777-af7d-0f658e3129e5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:27.690944 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-494bc840-5acf-4777-af7d-0f658e3129e5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:27.691737 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-494bc840-5acf-4777-af7d-0f658e3129e5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:28.001625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-494bc840-5acf-4777-af7d-0f658e3129e5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:28.014575 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-494bc840-5acf-4777-af7d-0f658e3129e5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1313 microversion: 2.1 time: 0.398241 Sep 26 18:05:28.016169 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 119/227] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:27 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:28.364282 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-152056f2-6021-4753-916b-1576651322d8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:28.364282 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-152056f2-6021-4753-916b-1576651322d8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:28.393475 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d7dd71fd-8e0c-48c1-8d01-3aa17e9db725 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd2b3474-c448-4c7b-b7c1-1bc76ea0a413"}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:28.397160 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-152056f2-6021-4753-916b-1576651322d8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:28.398254 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-152056f2-6021-4753-916b-1576651322d8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:28.399266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d7dd71fd-8e0c-48c1-8d01-3aa17e9db725 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:28.403883 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-152056f2-6021-4753-916b-1576651322d8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:28.409235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-152056f2-6021-4753-916b-1576651322d8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:28.411066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-152056f2-6021-4753-916b-1576651322d8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:28.413967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d7dd71fd-8e0c-48c1-8d01-3aa17e9db725 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:28.415581 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-152056f2-6021-4753-916b-1576651322d8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:28.416593 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d7dd71fd-8e0c-48c1-8d01-3aa17e9db725 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:28.418593 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d7dd71fd-8e0c-48c1-8d01-3aa17e9db725 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:28.420911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d7dd71fd-8e0c-48c1-8d01-3aa17e9db725 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:28.422186 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d7dd71fd-8e0c-48c1-8d01-3aa17e9db725 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:28.423138 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d7dd71fd-8e0c-48c1-8d01-3aa17e9db725 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:28.432429 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=100 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:28.713925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-152056f2-6021-4753-916b-1576651322d8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:28.723306 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-152056f2-6021-4753-916b-1576651322d8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.366393 Sep 26 18:05:28.723946 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 109/228] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:28 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:28.729350 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-cb48be3e-6853-4af5-9004-20d3767d4fb6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:28.730261 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-cb48be3e-6853-4af5-9004-20d3767d4fb6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:28.737239 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb48be3e-6853-4af5-9004-20d3767d4fb6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:28.737676 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb48be3e-6853-4af5-9004-20d3767d4fb6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:28.738184 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb48be3e-6853-4af5-9004-20d3767d4fb6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:28.738907 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb48be3e-6853-4af5-9004-20d3767d4fb6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:28.739356 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb48be3e-6853-4af5-9004-20d3767d4fb6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:28.739802 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb48be3e-6853-4af5-9004-20d3767d4fb6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:28.766989 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:28.902403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-cb48be3e-6853-4af5-9004-20d3767d4fb6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:28.942534 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-cb48be3e-6853-4af5-9004-20d3767d4fb6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1272 microversion: 2.1 time: 0.217084 Sep 26 18:05:28.943700 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 110/229] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:28 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:29.047224 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c7867f09-00fe-43e5-b0ab-df076108843f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:29.049200 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c7867f09-00fe-43e5-b0ab-df076108843f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:29.058397 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c7867f09-00fe-43e5-b0ab-df076108843f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:29.059522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c7867f09-00fe-43e5-b0ab-df076108843f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:29.062920 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c7867f09-00fe-43e5-b0ab-df076108843f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:29.062920 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c7867f09-00fe-43e5-b0ab-df076108843f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:29.065449 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c7867f09-00fe-43e5-b0ab-df076108843f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:29.066149 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c7867f09-00fe-43e5-b0ab-df076108843f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:29.485716 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c7867f09-00fe-43e5-b0ab-df076108843f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:29.496802 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c7867f09-00fe-43e5-b0ab-df076108843f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1313 microversion: 2.1 time: 0.454162 Sep 26 18:05:29.497425 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 111/230] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:29 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:29.764593 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8a4b7cd8-fb50-4db2-b2b0-3b7d613e3fc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:29.767949 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-8a4b7cd8-fb50-4db2-b2b0-3b7d613e3fc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:29.777298 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8a4b7cd8-fb50-4db2-b2b0-3b7d613e3fc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:29.778240 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8a4b7cd8-fb50-4db2-b2b0-3b7d613e3fc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:29.778955 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8a4b7cd8-fb50-4db2-b2b0-3b7d613e3fc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:29.779810 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8a4b7cd8-fb50-4db2-b2b0-3b7d613e3fc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:29.780588 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8a4b7cd8-fb50-4db2-b2b0-3b7d613e3fc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:29.781267 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8a4b7cd8-fb50-4db2-b2b0-3b7d613e3fc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:30.255145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-8a4b7cd8-fb50-4db2-b2b0-3b7d613e3fc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:30.264071 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-8a4b7cd8-fb50-4db2-b2b0-3b7d613e3fc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.505255 Sep 26 18:05:30.265160 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 112/231] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:29 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:30.270246 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bd29460a-c4a8-4025-a0c7-00c248a67aa6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:30.270916 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-bd29460a-c4a8-4025-a0c7-00c248a67aa6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:30.277756 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bd29460a-c4a8-4025-a0c7-00c248a67aa6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:30.278484 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bd29460a-c4a8-4025-a0c7-00c248a67aa6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:30.279073 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bd29460a-c4a8-4025-a0c7-00c248a67aa6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:30.287762 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bd29460a-c4a8-4025-a0c7-00c248a67aa6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:30.288668 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bd29460a-c4a8-4025-a0c7-00c248a67aa6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:30.289678 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bd29460a-c4a8-4025-a0c7-00c248a67aa6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:30.436461 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d7dd71fd-8e0c-48c1-8d01-3aa17e9db725 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "POST /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.049735 Sep 26 18:05:30.443358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 120/232] 10.222.0.67 () {60 vars in 1323 bytes} [Mon Sep 26 18:05:28 2022] POST /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73/os-volume_attachments => generated 194 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:05:30.530186 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-bc34bace-32df-422c-86d7-bfeda5a7bf57 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:30.531681 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-bc34bace-32df-422c-86d7-bfeda5a7bf57 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:30.541488 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc34bace-32df-422c-86d7-bfeda5a7bf57 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:30.543892 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc34bace-32df-422c-86d7-bfeda5a7bf57 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:30.544673 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc34bace-32df-422c-86d7-bfeda5a7bf57 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:30.546460 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc34bace-32df-422c-86d7-bfeda5a7bf57 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:30.547347 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc34bace-32df-422c-86d7-bfeda5a7bf57 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:30.548031 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc34bace-32df-422c-86d7-bfeda5a7bf57 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:30.596648 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=6 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:30.810965 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bd29460a-c4a8-4025-a0c7-00c248a67aa6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:30.820570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bd29460a-c4a8-4025-a0c7-00c248a67aa6 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1314 microversion: 2.1 time: 0.554257 Sep 26 18:05:30.821913 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 113/233] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:30 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:31.108195 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-bc34bace-32df-422c-86d7-bfeda5a7bf57 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:31.125561 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-bc34bace-32df-422c-86d7-bfeda5a7bf57 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1313 microversion: 2.1 time: 0.600299 Sep 26 18:05:31.134913 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 121/234] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:30 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1313 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:31.307739 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a56f7ac7-8ddd-4955-a4fa-2ccb94e9902d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:31.311285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a56f7ac7-8ddd-4955-a4fa-2ccb94e9902d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:31.343264 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a56f7ac7-8ddd-4955-a4fa-2ccb94e9902d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:31.350812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a56f7ac7-8ddd-4955-a4fa-2ccb94e9902d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:31.352084 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a56f7ac7-8ddd-4955-a4fa-2ccb94e9902d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:31.359948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a56f7ac7-8ddd-4955-a4fa-2ccb94e9902d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:31.361764 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a56f7ac7-8ddd-4955-a4fa-2ccb94e9902d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:31.363178 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a56f7ac7-8ddd-4955-a4fa-2ccb94e9902d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:31.854110 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=2 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:31.854110 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=8 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:31.864190 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d46e9b3e-c11d-4ad6-8488-6d94a932070a tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:31.865214 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d46e9b3e-c11d-4ad6-8488-6d94a932070a tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:31.887199 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d46e9b3e-c11d-4ad6-8488-6d94a932070a tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:31.888231 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d46e9b3e-c11d-4ad6-8488-6d94a932070a tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:31.888941 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d46e9b3e-c11d-4ad6-8488-6d94a932070a tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:31.890122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d46e9b3e-c11d-4ad6-8488-6d94a932070a tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:31.895487 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d46e9b3e-c11d-4ad6-8488-6d94a932070a tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:31.899238 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d46e9b3e-c11d-4ad6-8488-6d94a932070a tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:31.964092 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a56f7ac7-8ddd-4955-a4fa-2ccb94e9902d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:32.007409 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a56f7ac7-8ddd-4955-a4fa-2ccb94e9902d tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.703809 Sep 26 18:05:32.019768 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 114/235] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:31 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:32.169226 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-24ffd14d-fa24-4a3c-aa62-4d0375b72322 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:32.169989 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-24ffd14d-fa24-4a3c-aa62-4d0375b72322 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:32.186199 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-24ffd14d-fa24-4a3c-aa62-4d0375b72322 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:32.187682 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-24ffd14d-fa24-4a3c-aa62-4d0375b72322 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:32.188327 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-24ffd14d-fa24-4a3c-aa62-4d0375b72322 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:32.190858 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-24ffd14d-fa24-4a3c-aa62-4d0375b72322 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:32.191899 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-24ffd14d-fa24-4a3c-aa62-4d0375b72322 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:32.192628 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-24ffd14d-fa24-4a3c-aa62-4d0375b72322 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:32.497433 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-24ffd14d-fa24-4a3c-aa62-4d0375b72322 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:32.502732 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d46e9b3e-c11d-4ad6-8488-6d94a932070a tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:32.511342 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-24ffd14d-fa24-4a3c-aa62-4d0375b72322 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1313 microversion: 2.1 time: 0.346632 Sep 26 18:05:32.512020 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 115/236] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:32 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:32.520867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d46e9b3e-c11d-4ad6-8488-6d94a932070a tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1314 microversion: 2.1 time: 0.674715 Sep 26 18:05:32.521891 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 122/237] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:31 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:32.666234 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-41ea1506-4252-490e-bb63-5758fb13ff87 req-f64700a1-f417-48c7-8a89-777f84576b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3f7652f-6765-4967-9ff6-f112a4b367e9", "name": "network-vif-plugged", "status": "completed", "tag": "c786b600-af8e-47b7-8eb2-2b3abde7c6a6"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:32.695066 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-41ea1506-4252-490e-bb63-5758fb13ff87 req-f64700a1-f417-48c7-8a89-777f84576b65 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:32.695794 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-41ea1506-4252-490e-bb63-5758fb13ff87 req-f64700a1-f417-48c7-8a89-777f84576b65 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:32.696633 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-41ea1506-4252-490e-bb63-5758fb13ff87 req-f64700a1-f417-48c7-8a89-777f84576b65 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:32.715062 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5a40e46f-295e-4ffe-9c75-c79d871f6e81 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Action: 'create', calling method: .version_select at 0x7f3a74c31550>, body: {"keypair": {"name": "tempest-keypair-1740863839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwVySJRk9+0I8VnCXEFHdJKOIe0qP/9/XamFj7sa0oN/FkhsJge3RIHohYjKx+zbriwpNydChSuHA2W8biPVytiH1XRuwhR4sQLcMurPURkkszftjFd7NPq0FeuKBlc8A=="}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:32.724808 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-41ea1506-4252-490e-bb63-5758fb13ff87 req-f64700a1-f417-48c7-8a89-777f84576b65 service nova] Creating event network-vif-plugged:c786b600-af8e-47b7-8eb2-2b3abde7c6a6 for instance c3f7652f-6765-4967-9ff6-f112a4b367e9 on hv-cinder-85931 Sep 26 18:05:32.734993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-41ea1506-4252-490e-bb63-5758fb13ff87 req-f64700a1-f417-48c7-8a89-777f84576b65 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085508 Sep 26 18:05:32.737580 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 123/238] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:05:32.742805 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-5a40e46f-295e-4ffe-9c75-c79d871f6e81 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Getting quotas for project f6595854cfb04a11994c6aed8f5857c6. Resources: {'key_pairs'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:05:32.744081 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-f12dc68c-155b-4394-aa8a-65ed0de3207c req-1909bb20-680d-4964-a5ff-135d7747fb5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692e2930-4f2e-4999-be6a-e3824248177d", "tag": "77f9ad03-b62f-4dda-ba71-0c74b66daab5"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:32.748434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-5a40e46f-295e-4ffe-9c75-c79d871f6e81 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Getting quotas for user 612875c8fc7240e5b18fe38a034a3ef5 and project f6595854cfb04a11994c6aed8f5857c6. Resources: {'key_pairs'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:05:32.760066 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-f12dc68c-155b-4394-aa8a-65ed0de3207c req-1909bb20-680d-4964-a5ff-135d7747fb5d service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:32.760616 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-f12dc68c-155b-4394-aa8a-65ed0de3207c req-1909bb20-680d-4964-a5ff-135d7747fb5d service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:32.761417 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-f12dc68c-155b-4394-aa8a-65ed0de3207c req-1909bb20-680d-4964-a5ff-135d7747fb5d service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:32.780026 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-f12dc68c-155b-4394-aa8a-65ed0de3207c req-1909bb20-680d-4964-a5ff-135d7747fb5d service nova] Creating event network-changed:77f9ad03-b62f-4dda-ba71-0c74b66daab5 for instance 692e2930-4f2e-4999-be6a-e3824248177d on hv-cinder-85931 Sep 26 18:05:32.787202 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-f12dc68c-155b-4394-aa8a-65ed0de3207c req-1909bb20-680d-4964-a5ff-135d7747fb5d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046997 Sep 26 18:05:32.788289 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 124/239] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:05:33.028839 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5a40e46f-295e-4ffe-9c75-c79d871f6e81 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.511367 Sep 26 18:05:33.038513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 116/240] 10.222.0.67 () {62 vars in 1200 bytes} [Mon Sep 26 18:05:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 524 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 26 18:05:33.056619 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-37b5b6f8-40cf-4c2a-8aba-4935ca093f72 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:33.058092 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-37b5b6f8-40cf-4c2a-8aba-4935ca093f72 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:33.062121 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:33.067107 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-37b5b6f8-40cf-4c2a-8aba-4935ca093f72 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:33.067902 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-37b5b6f8-40cf-4c2a-8aba-4935ca093f72 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:33.068540 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-37b5b6f8-40cf-4c2a-8aba-4935ca093f72 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:33.069410 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-37b5b6f8-40cf-4c2a-8aba-4935ca093f72 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:33.069921 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-37b5b6f8-40cf-4c2a-8aba-4935ca093f72 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:33.070346 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-37b5b6f8-40cf-4c2a-8aba-4935ca093f72 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:33.429316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-37b5b6f8-40cf-4c2a-8aba-4935ca093f72 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:33.445193 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-37b5b6f8-40cf-4c2a-8aba-4935ca093f72 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.393398 Sep 26 18:05:33.447094 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 125/241] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:33 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:33.572954 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f3fbac72-e04d-4f6f-bd2f-ee6c9aa21f0c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:33.576452 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f3fbac72-e04d-4f6f-bd2f-ee6c9aa21f0c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:33.581421 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-0677b160-23d9-4da2-a14e-3a315217020b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:33.585995 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-0677b160-23d9-4da2-a14e-3a315217020b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:33.631042 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f3fbac72-e04d-4f6f-bd2f-ee6c9aa21f0c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:33.634558 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f3fbac72-e04d-4f6f-bd2f-ee6c9aa21f0c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:33.637929 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f3fbac72-e04d-4f6f-bd2f-ee6c9aa21f0c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:33.639622 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0677b160-23d9-4da2-a14e-3a315217020b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:33.642532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f3fbac72-e04d-4f6f-bd2f-ee6c9aa21f0c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:33.646288 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0677b160-23d9-4da2-a14e-3a315217020b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:33.648831 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0677b160-23d9-4da2-a14e-3a315217020b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:33.656311 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0677b160-23d9-4da2-a14e-3a315217020b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:33.658943 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0677b160-23d9-4da2-a14e-3a315217020b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:33.659985 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0677b160-23d9-4da2-a14e-3a315217020b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:33.662121 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f3fbac72-e04d-4f6f-bd2f-ee6c9aa21f0c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:33.673255 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f3fbac72-e04d-4f6f-bd2f-ee6c9aa21f0c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:34.050964 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-0677b160-23d9-4da2-a14e-3a315217020b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:34.059045 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-0677b160-23d9-4da2-a14e-3a315217020b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1313 microversion: 2.1 time: 0.507597 Sep 26 18:05:34.059631 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 117/242] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:33 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:34.114864 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f3fbac72-e04d-4f6f-bd2f-ee6c9aa21f0c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:34.123967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f3fbac72-e04d-4f6f-bd2f-ee6c9aa21f0c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1314 microversion: 2.1 time: 0.567023 Sep 26 18:05:34.125399 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 126/243] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:33 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:34.483030 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-457ef939-3f80-4122-abba-eff0544233e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:34.483667 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-457ef939-3f80-4122-abba-eff0544233e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:34.485837 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:34.491321 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-457ef939-3f80-4122-abba-eff0544233e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:34.492229 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-457ef939-3f80-4122-abba-eff0544233e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:34.493158 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-457ef939-3f80-4122-abba-eff0544233e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:34.494279 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-457ef939-3f80-4122-abba-eff0544233e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:34.495087 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-457ef939-3f80-4122-abba-eff0544233e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:34.495878 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-457ef939-3f80-4122-abba-eff0544233e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:34.692341 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-457ef939-3f80-4122-abba-eff0544233e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:34.700845 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-457ef939-3f80-4122-abba-eff0544233e8 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.221842 Sep 26 18:05:34.704381 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 118/244] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:34 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:35.094162 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9d91263e-861e-47fd-8212-43f864b03aab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:35.095104 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9d91263e-861e-47fd-8212-43f864b03aab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:35.102242 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d91263e-861e-47fd-8212-43f864b03aab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:35.102785 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d91263e-861e-47fd-8212-43f864b03aab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:35.103223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d91263e-861e-47fd-8212-43f864b03aab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:35.104009 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d91263e-861e-47fd-8212-43f864b03aab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:35.104638 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d91263e-861e-47fd-8212-43f864b03aab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:35.107732 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d91263e-861e-47fd-8212-43f864b03aab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:35.158573 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-edd6e7cc-3a57-421b-a945-353b9467c6ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:35.159333 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-edd6e7cc-3a57-421b-a945-353b9467c6ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:35.169055 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-edd6e7cc-3a57-421b-a945-353b9467c6ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:35.169855 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-edd6e7cc-3a57-421b-a945-353b9467c6ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:35.171495 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-edd6e7cc-3a57-421b-a945-353b9467c6ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:35.174888 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-edd6e7cc-3a57-421b-a945-353b9467c6ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:35.187932 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-edd6e7cc-3a57-421b-a945-353b9467c6ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:35.188834 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-edd6e7cc-3a57-421b-a945-353b9467c6ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:35.512801 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9d91263e-861e-47fd-8212-43f864b03aab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:35.529349 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-edd6e7cc-3a57-421b-a945-353b9467c6ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:35.534649 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9d91263e-861e-47fd-8212-43f864b03aab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1313 microversion: 2.1 time: 0.443390 Sep 26 18:05:35.534649 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 127/245] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:35 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:35.543262 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-edd6e7cc-3a57-421b-a945-353b9467c6ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1314 microversion: 2.1 time: 0.388612 Sep 26 18:05:35.544468 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 119/246] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:35 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:35.730866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e3656c13-488f-4686-a551-7c42063267a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:35.731997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e3656c13-488f-4686-a551-7c42063267a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:35.778792 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e3656c13-488f-4686-a551-7c42063267a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:35.780166 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e3656c13-488f-4686-a551-7c42063267a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:35.782713 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e3656c13-488f-4686-a551-7c42063267a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:35.784230 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e3656c13-488f-4686-a551-7c42063267a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:35.784721 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e3656c13-488f-4686-a551-7c42063267a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:35.785147 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e3656c13-488f-4686-a551-7c42063267a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:36.282157 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e3656c13-488f-4686-a551-7c42063267a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:36.292012 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e3656c13-488f-4686-a551-7c42063267a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.569561 Sep 26 18:05:36.292641 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 128/247] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:35 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:36.579207 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4ebdbba5-fa92-4f3f-ac24-d53d1c1e4453 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:36.580419 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4ebdbba5-fa92-4f3f-ac24-d53d1c1e4453 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:36.581260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-0b358b9e-55ce-476b-a264-0f558991ba99 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:36.581954 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-0b358b9e-55ce-476b-a264-0f558991ba99 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:36.598204 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0b358b9e-55ce-476b-a264-0f558991ba99 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:36.598741 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0b358b9e-55ce-476b-a264-0f558991ba99 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:36.599193 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0b358b9e-55ce-476b-a264-0f558991ba99 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:36.599965 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0b358b9e-55ce-476b-a264-0f558991ba99 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:36.600429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0b358b9e-55ce-476b-a264-0f558991ba99 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:36.600557 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ebdbba5-fa92-4f3f-ac24-d53d1c1e4453 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:36.600860 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0b358b9e-55ce-476b-a264-0f558991ba99 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:36.601547 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ebdbba5-fa92-4f3f-ac24-d53d1c1e4453 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:36.602608 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ebdbba5-fa92-4f3f-ac24-d53d1c1e4453 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:36.604106 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ebdbba5-fa92-4f3f-ac24-d53d1c1e4453 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:36.605223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ebdbba5-fa92-4f3f-ac24-d53d1c1e4453 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:36.606251 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4ebdbba5-fa92-4f3f-ac24-d53d1c1e4453 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:36.900899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-4ebdbba5-fa92-4f3f-ac24-d53d1c1e4453 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:36.904114 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-0b358b9e-55ce-476b-a264-0f558991ba99 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:36.922046 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-0b358b9e-55ce-476b-a264-0f558991ba99 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1313 microversion: 2.1 time: 0.367076 Sep 26 18:05:36.922960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 120/248] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:36 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:36.931170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4ebdbba5-fa92-4f3f-ac24-d53d1c1e4453 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1314 microversion: 2.1 time: 0.363493 Sep 26 18:05:36.945629 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 129/249] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:36 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:37.320179 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f655e9a9-90de-4e4d-bb81-a6d7d0dc3eb3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:37.320953 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f655e9a9-90de-4e4d-bb81-a6d7d0dc3eb3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:37.336759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f655e9a9-90de-4e4d-bb81-a6d7d0dc3eb3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:37.337376 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f655e9a9-90de-4e4d-bb81-a6d7d0dc3eb3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:37.347263 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f655e9a9-90de-4e4d-bb81-a6d7d0dc3eb3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:37.348705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f655e9a9-90de-4e4d-bb81-a6d7d0dc3eb3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:37.349429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f655e9a9-90de-4e4d-bb81-a6d7d0dc3eb3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:37.350068 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f655e9a9-90de-4e4d-bb81-a6d7d0dc3eb3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:37.427362 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1299933793", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce568303-84c8-4c5c-8d2c-8e418731567a"}], "security_groups": [{"name": "tempest-securitygroup--1485268117"}], "key_name": "tempest-keypair-1740863839", "user_data": "}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:37.787438 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.network.neutron [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] validate_networks() for [('ce568303-84c8-4c5c-8d2c-8e418731567a', None, None, None, None, None)] {{(pid=121028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:05:38.010760 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f655e9a9-90de-4e4d-bb81-a6d7d0dc3eb3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:38.023253 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f655e9a9-90de-4e4d-bb81-a6d7d0dc3eb3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.709796 Sep 26 18:05:38.025295 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 121/250] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:37 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:38.030942 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-005af1dd-dab2-4088-a1d7-5fcd620b15d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:38.031790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-005af1dd-dab2-4088-a1d7-5fcd620b15d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:38.043249 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-005af1dd-dab2-4088-a1d7-5fcd620b15d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:38.043935 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-005af1dd-dab2-4088-a1d7-5fcd620b15d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:38.044542 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-005af1dd-dab2-4088-a1d7-5fcd620b15d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:38.045557 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-005af1dd-dab2-4088-a1d7-5fcd620b15d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:38.046457 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-005af1dd-dab2-4088-a1d7-5fcd620b15d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:38.047072 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-005af1dd-dab2-4088-a1d7-5fcd620b15d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:38.528037 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-005af1dd-dab2-4088-a1d7-5fcd620b15d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:38.538656 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-005af1dd-dab2-4088-a1d7-5fcd620b15d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1497 microversion: 2.1 time: 0.511873 Sep 26 18:05:38.539251 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 122/251] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:38 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1497 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:38.548751 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-95950e61-fe71-4ef9-81d4-1b49e2b2104c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:38.549411 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-95950e61-fe71-4ef9-81d4-1b49e2b2104c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:38.558283 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95950e61-fe71-4ef9-81d4-1b49e2b2104c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:38.558783 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95950e61-fe71-4ef9-81d4-1b49e2b2104c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:38.559235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95950e61-fe71-4ef9-81d4-1b49e2b2104c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:38.560090 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95950e61-fe71-4ef9-81d4-1b49e2b2104c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:38.560975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95950e61-fe71-4ef9-81d4-1b49e2b2104c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:38.561576 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95950e61-fe71-4ef9-81d4-1b49e2b2104c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:39.013905 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Flavor limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:05:39.015223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Image limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:05:39.015893 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Flavor pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:05:39.022815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Image pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:05:39.022815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:05:39.027376 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:39.027376 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:39.027871 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:39.028639 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:39.029296 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:39.029567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:39.053854 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-95950e61-fe71-4ef9-81d4-1b49e2b2104c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:39.057512 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Getting quotas for project f6595854cfb04a11994c6aed8f5857c6. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:05:39.064223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Getting quotas for user 612875c8fc7240e5b18fe38a034a3ef5 and project f6595854cfb04a11994c6aed8f5857c6. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:05:39.067868 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-95950e61-fe71-4ef9-81d4-1b49e2b2104c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1314 microversion: 2.1 time: 0.527091 Sep 26 18:05:39.069009 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 123/252] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:38 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:39.078239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Going to run 1 instances... {{(pid=121028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:05:39.081068 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:05:39.100051 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8ce61130-c79f-41b0-b182-b6dd30a8d599 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:39.100051 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-8ce61130-c79f-41b0-b182-b6dd30a8d599 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:39.104343 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8ce61130-c79f-41b0-b182-b6dd30a8d599 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:39.105107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8ce61130-c79f-41b0-b182-b6dd30a8d599 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:39.105875 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8ce61130-c79f-41b0-b182-b6dd30a8d599 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:39.107003 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8ce61130-c79f-41b0-b182-b6dd30a8d599 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:39.107822 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8ce61130-c79f-41b0-b182-b6dd30a8d599 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:39.108796 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8ce61130-c79f-41b0-b182-b6dd30a8d599 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:39.280591 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-8ce61130-c79f-41b0-b182-b6dd30a8d599 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:39.287206 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-8ce61130-c79f-41b0-b182-b6dd30a8d599 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.216105 Sep 26 18:05:39.288176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 124/253] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:39 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:39.402337 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c1ebf975-3b65-4403-a9ce-a77c88ce346e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.979694 Sep 26 18:05:39.403565 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 130/254] 10.222.0.67 () {62 vars in 1188 bytes} [Mon Sep 26 18:05:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 26 18:05:39.419726 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bc5821e8-9cfc-46c4-bccc-029839a07616 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:39.420435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-bc5821e8-9cfc-46c4-bccc-029839a07616 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:39.499136 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bc5821e8-9cfc-46c4-bccc-029839a07616 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:39.531605 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bc5821e8-9cfc-46c4-bccc-029839a07616 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:39.534116 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bc5821e8-9cfc-46c4-bccc-029839a07616 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:39.536473 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bc5821e8-9cfc-46c4-bccc-029839a07616 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1282 microversion: 2.20 time: 0.121378 Sep 26 18:05:39.554482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 125/255] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:39 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1282 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:05:40.095787 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ae0238be-6b04-471c-9092-76c107212007 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:40.096617 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ae0238be-6b04-471c-9092-76c107212007 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:40.103144 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ae0238be-6b04-471c-9092-76c107212007 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:40.103717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ae0238be-6b04-471c-9092-76c107212007 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:40.104195 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ae0238be-6b04-471c-9092-76c107212007 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:40.107837 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ae0238be-6b04-471c-9092-76c107212007 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:40.108320 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ae0238be-6b04-471c-9092-76c107212007 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:40.108757 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ae0238be-6b04-471c-9092-76c107212007 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:40.176570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-19e3395f-8920-4b0b-b1e1-ff2996439449 req-0d678afb-a2df-458b-8cc8-9688a158d5cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692e2930-4f2e-4999-be6a-e3824248177d", "name": "network-vif-plugged", "status": "completed", "tag": "77f9ad03-b62f-4dda-ba71-0c74b66daab5"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:40.197832 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-19e3395f-8920-4b0b-b1e1-ff2996439449 req-0d678afb-a2df-458b-8cc8-9688a158d5cc service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:40.198386 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-19e3395f-8920-4b0b-b1e1-ff2996439449 req-0d678afb-a2df-458b-8cc8-9688a158d5cc service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:40.208564 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-19e3395f-8920-4b0b-b1e1-ff2996439449 req-0d678afb-a2df-458b-8cc8-9688a158d5cc service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:40.221188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-19e3395f-8920-4b0b-b1e1-ff2996439449 req-0d678afb-a2df-458b-8cc8-9688a158d5cc service nova] Creating event network-vif-plugged:77f9ad03-b62f-4dda-ba71-0c74b66daab5 for instance 692e2930-4f2e-4999-be6a-e3824248177d on hv-cinder-85931 Sep 26 18:05:40.227095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-19e3395f-8920-4b0b-b1e1-ff2996439449 req-0d678afb-a2df-458b-8cc8-9688a158d5cc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055383 Sep 26 18:05:40.227766 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 126/256] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:05:40.293885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ae0238be-6b04-471c-9092-76c107212007 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:40.309822 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-82b0d250-3cee-424d-89a4-4a1f5da5689b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:40.310401 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-82b0d250-3cee-424d-89a4-4a1f5da5689b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:40.317456 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-82b0d250-3cee-424d-89a4-4a1f5da5689b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:40.317957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-82b0d250-3cee-424d-89a4-4a1f5da5689b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:40.318377 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-82b0d250-3cee-424d-89a4-4a1f5da5689b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:40.319121 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-82b0d250-3cee-424d-89a4-4a1f5da5689b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:40.319558 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-82b0d250-3cee-424d-89a4-4a1f5da5689b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:40.319752 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ae0238be-6b04-471c-9092-76c107212007 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1314 microversion: 2.1 time: 0.228198 Sep 26 18:05:40.320000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-82b0d250-3cee-424d-89a4-4a1f5da5689b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:40.320608 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 131/257] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:40 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:40.333714 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b6c883df-34aa-44c2-b7ff-68f74cf53230 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:40.334380 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b6c883df-34aa-44c2-b7ff-68f74cf53230 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:40.341026 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6c883df-34aa-44c2-b7ff-68f74cf53230 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:40.341520 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6c883df-34aa-44c2-b7ff-68f74cf53230 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:40.341953 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6c883df-34aa-44c2-b7ff-68f74cf53230 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:40.342679 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6c883df-34aa-44c2-b7ff-68f74cf53230 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:40.343140 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6c883df-34aa-44c2-b7ff-68f74cf53230 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:40.343571 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6c883df-34aa-44c2-b7ff-68f74cf53230 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:40.349964 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-82b0d250-3cee-424d-89a4-4a1f5da5689b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Going to try to terminate instance {{(pid=121029) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:05:40.506431 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b6c883df-34aa-44c2-b7ff-68f74cf53230 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:40.516484 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b6c883df-34aa-44c2-b7ff-68f74cf53230 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.194260 Sep 26 18:05:40.524482 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 132/258] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:40 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:40.568047 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-90f8c9e8-6642-4fd9-a53d-929b92422a1b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:40.568750 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-90f8c9e8-6642-4fd9-a53d-929b92422a1b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:40.627706 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:40.630175 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-90f8c9e8-6642-4fd9-a53d-929b92422a1b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:40.641029 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-90f8c9e8-6642-4fd9-a53d-929b92422a1b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:40.644368 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-90f8c9e8-6642-4fd9-a53d-929b92422a1b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:40.644818 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-90f8c9e8-6642-4fd9-a53d-929b92422a1b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1282 microversion: 2.20 time: 0.082462 Sep 26 18:05:40.663900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 133/259] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:40 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:05:41.350475 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9d69b485-9089-473e-9a4d-75bf55ab6d6b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:41.351552 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9d69b485-9089-473e-9a4d-75bf55ab6d6b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:41.360678 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d69b485-9089-473e-9a4d-75bf55ab6d6b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:41.360678 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d69b485-9089-473e-9a4d-75bf55ab6d6b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:41.384761 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d69b485-9089-473e-9a4d-75bf55ab6d6b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:41.384761 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d69b485-9089-473e-9a4d-75bf55ab6d6b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:41.384761 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d69b485-9089-473e-9a4d-75bf55ab6d6b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:41.384761 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d69b485-9089-473e-9a4d-75bf55ab6d6b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:41.512325 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9d69b485-9089-473e-9a4d-75bf55ab6d6b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:41.522573 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9d69b485-9089-473e-9a4d-75bf55ab6d6b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1314 microversion: 2.1 time: 0.179396 Sep 26 18:05:41.523491 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 134/260] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:41 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:41.551674 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f1672d90-9914-46f4-89d7-00c4415e339e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:41.552326 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f1672d90-9914-46f4-89d7-00c4415e339e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:41.561472 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1672d90-9914-46f4-89d7-00c4415e339e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:41.577474 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1672d90-9914-46f4-89d7-00c4415e339e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:41.577474 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1672d90-9914-46f4-89d7-00c4415e339e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:41.577474 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1672d90-9914-46f4-89d7-00c4415e339e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:41.577474 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1672d90-9914-46f4-89d7-00c4415e339e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:41.578010 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1672d90-9914-46f4-89d7-00c4415e339e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:41.670261 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-82b0d250-3cee-424d-89a4-4a1f5da5689b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 204 len: 0 microversion: 2.1 time: 1.364293 Sep 26 18:05:41.673476 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 127/261] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:05:40 2022] DELETE /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 0 bytes in 1367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 18:05:41.682304 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-88deb592-5bc5-48bd-9cc5-66221ac9d4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:41.682909 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-88deb592-5bc5-48bd-9cc5-66221ac9d4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:41.760942 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-88deb592-5bc5-48bd-9cc5-66221ac9d4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:41.769634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-88deb592-5bc5-48bd-9cc5-66221ac9d4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:41.771092 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-88deb592-5bc5-48bd-9cc5-66221ac9d4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:41.772275 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-88deb592-5bc5-48bd-9cc5-66221ac9d4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1282 microversion: 2.20 time: 0.096992 Sep 26 18:05:41.772832 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 128/262] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:41 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:41.777697 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a4b54c6c-8c4d-485b-9bbb-9e5943bbb3ad tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:41.781043 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a4b54c6c-8c4d-485b-9bbb-9e5943bbb3ad tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:41.781237 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f1672d90-9914-46f4-89d7-00c4415e339e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:41.788655 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f1672d90-9914-46f4-89d7-00c4415e339e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.241518 Sep 26 18:05:41.791367 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a4b54c6c-8c4d-485b-9bbb-9e5943bbb3ad tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:41.792288 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a4b54c6c-8c4d-485b-9bbb-9e5943bbb3ad tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:41.793068 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a4b54c6c-8c4d-485b-9bbb-9e5943bbb3ad tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:41.794348 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a4b54c6c-8c4d-485b-9bbb-9e5943bbb3ad tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:41.795319 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a4b54c6c-8c4d-485b-9bbb-9e5943bbb3ad tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:41.795965 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 135/263] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:41 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:41.796201 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a4b54c6c-8c4d-485b-9bbb-9e5943bbb3ad tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:41.991494 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a4b54c6c-8c4d-485b-9bbb-9e5943bbb3ad tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:42.002946 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a4b54c6c-8c4d-485b-9bbb-9e5943bbb3ad tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1503 microversion: 2.1 time: 0.228904 Sep 26 18:05:42.003833 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 129/264] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:41 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:42.085029 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e78cc79f-261b-4192-868e-4d7a53da44e8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Action: 'create', calling method: .version_select at 0x7f3a74df5820>, body: {"keypair": {"name": "tempest-keypair-1095959337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhrX51x+nhVl9lxMU7OzA//a95geWnK5BMpAxNp0GzQifdBPDPeqN01pZ3PSKyhSfKkjdqrSnAvYd6mUYQeM5bfompFH1Mwddib9DsiaY1QtT/AQsoVs51mWQ3ktwuXmw=="}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:42.103431 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-e78cc79f-261b-4192-868e-4d7a53da44e8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Getting quotas for project ffa58ff5197e48709d5c90ec334b9403. Resources: {'key_pairs'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:05:42.107368 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-e78cc79f-261b-4192-868e-4d7a53da44e8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Getting quotas for user 0bede3a601f941e7abc9fd16983679b2 and project ffa58ff5197e48709d5c90ec334b9403. Resources: {'key_pairs'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:05:42.284402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e78cc79f-261b-4192-868e-4d7a53da44e8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.204583 Sep 26 18:05:42.289731 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 136/265] 10.222.0.67 () {60 vars in 1159 bytes} [Mon Sep 26 18:05:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:05:42.545346 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b1e0b125-1a4b-48c1-91ed-23bad5ab0f06 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:42.546831 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b1e0b125-1a4b-48c1-91ed-23bad5ab0f06 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:42.556828 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1e0b125-1a4b-48c1-91ed-23bad5ab0f06 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:42.557573 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1e0b125-1a4b-48c1-91ed-23bad5ab0f06 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:42.558226 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1e0b125-1a4b-48c1-91ed-23bad5ab0f06 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:42.559113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1e0b125-1a4b-48c1-91ed-23bad5ab0f06 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:42.559763 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1e0b125-1a4b-48c1-91ed-23bad5ab0f06 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:42.560472 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1e0b125-1a4b-48c1-91ed-23bad5ab0f06 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:42.729825 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b1e0b125-1a4b-48c1-91ed-23bad5ab0f06 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:42.741622 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b1e0b125-1a4b-48c1-91ed-23bad5ab0f06 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1314 microversion: 2.1 time: 0.200056 Sep 26 18:05:42.742210 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 130/266] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:42 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:42.800201 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-11954082-96fc-4f11-884f-d03fd9b2d2b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:42.800957 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-11954082-96fc-4f11-884f-d03fd9b2d2b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:42.807055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-11954082-96fc-4f11-884f-d03fd9b2d2b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:42.807532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-11954082-96fc-4f11-884f-d03fd9b2d2b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:42.808043 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-11954082-96fc-4f11-884f-d03fd9b2d2b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:42.809024 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-11954082-96fc-4f11-884f-d03fd9b2d2b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:42.809410 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-11954082-96fc-4f11-884f-d03fd9b2d2b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:42.809828 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-11954082-96fc-4f11-884f-d03fd9b2d2b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:42.813254 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ad991dda-197e-451e-a5c7-f774983250ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:42.815189 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ad991dda-197e-451e-a5c7-f774983250ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:42.820974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad991dda-197e-451e-a5c7-f774983250ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:42.821458 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad991dda-197e-451e-a5c7-f774983250ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:42.821883 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad991dda-197e-451e-a5c7-f774983250ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:42.822949 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad991dda-197e-451e-a5c7-f774983250ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:42.823383 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad991dda-197e-451e-a5c7-f774983250ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:42.823839 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad991dda-197e-451e-a5c7-f774983250ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:42.888250 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-11954082-96fc-4f11-884f-d03fd9b2d2b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:42.902659 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-11954082-96fc-4f11-884f-d03fd9b2d2b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:42.905008 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-11954082-96fc-4f11-884f-d03fd9b2d2b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:42.906416 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-11954082-96fc-4f11-884f-d03fd9b2d2b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1286 microversion: 2.20 time: 0.110784 Sep 26 18:05:42.907140 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 137/267] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:42 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:05:43.027616 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9524530e-9130-418a-bd27-81ed2725200b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:43.028279 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9524530e-9130-418a-bd27-81ed2725200b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:43.035922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9524530e-9130-418a-bd27-81ed2725200b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:43.036536 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9524530e-9130-418a-bd27-81ed2725200b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:43.037241 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9524530e-9130-418a-bd27-81ed2725200b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:43.038457 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9524530e-9130-418a-bd27-81ed2725200b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:43.038701 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ad991dda-197e-451e-a5c7-f774983250ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:43.039099 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9524530e-9130-418a-bd27-81ed2725200b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:43.039758 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9524530e-9130-418a-bd27-81ed2725200b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:43.051927 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ad991dda-197e-451e-a5c7-f774983250ba tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.241606 Sep 26 18:05:43.067812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 131/268] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:42 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:43.287498 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9524530e-9130-418a-bd27-81ed2725200b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:43.300147 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9524530e-9130-418a-bd27-81ed2725200b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1503 microversion: 2.1 time: 0.276378 Sep 26 18:05:43.301096 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 138/269] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:43 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:43.768495 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ebc4d0eb-52e5-49cb-ac16-329e7328038c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:43.768495 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ebc4d0eb-52e5-49cb-ac16-329e7328038c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:43.780459 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ebc4d0eb-52e5-49cb-ac16-329e7328038c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:43.780459 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ebc4d0eb-52e5-49cb-ac16-329e7328038c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:43.780459 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ebc4d0eb-52e5-49cb-ac16-329e7328038c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:43.780459 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ebc4d0eb-52e5-49cb-ac16-329e7328038c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:43.780821 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ebc4d0eb-52e5-49cb-ac16-329e7328038c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:43.780821 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ebc4d0eb-52e5-49cb-ac16-329e7328038c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:43.934625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8d35f173-969e-455d-9818-fa0ed4599da5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:43.935228 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-8d35f173-969e-455d-9818-fa0ed4599da5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:43.942298 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8d35f173-969e-455d-9818-fa0ed4599da5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:43.942793 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8d35f173-969e-455d-9818-fa0ed4599da5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:43.943222 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8d35f173-969e-455d-9818-fa0ed4599da5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:43.944016 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8d35f173-969e-455d-9818-fa0ed4599da5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:43.944465 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8d35f173-969e-455d-9818-fa0ed4599da5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:43.945040 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8d35f173-969e-455d-9818-fa0ed4599da5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:43.973925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ebc4d0eb-52e5-49cb-ac16-329e7328038c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:43.976163 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:43.992117 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ebc4d0eb-52e5-49cb-ac16-329e7328038c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1314 microversion: 2.1 time: 0.229999 Sep 26 18:05:44.009851 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 132/270] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:43 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:44.075440 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e84b0c9a-9fa3-427c-9053-4d145e48c475 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:44.084113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e84b0c9a-9fa3-427c-9053-4d145e48c475 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:44.085758 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8d35f173-969e-455d-9818-fa0ed4599da5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:44.086071 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e84b0c9a-9fa3-427c-9053-4d145e48c475 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:44.086585 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e84b0c9a-9fa3-427c-9053-4d145e48c475 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:44.087030 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e84b0c9a-9fa3-427c-9053-4d145e48c475 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:44.087893 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e84b0c9a-9fa3-427c-9053-4d145e48c475 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:44.088361 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e84b0c9a-9fa3-427c-9053-4d145e48c475 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:44.088797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e84b0c9a-9fa3-427c-9053-4d145e48c475 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:44.101456 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8d35f173-969e-455d-9818-fa0ed4599da5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:44.103288 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8d35f173-969e-455d-9818-fa0ed4599da5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:44.104890 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8d35f173-969e-455d-9818-fa0ed4599da5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1286 microversion: 2.20 time: 0.174179 Sep 26 18:05:44.105667 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 139/271] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:43 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1286 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:44.262241 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e84b0c9a-9fa3-427c-9053-4d145e48c475 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:44.272388 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e84b0c9a-9fa3-427c-9053-4d145e48c475 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.200853 Sep 26 18:05:44.272963 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 133/272] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:44 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:44.342351 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4a406123-2e16-4d56-ae66-88bcdaa9af9d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:44.342351 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4a406123-2e16-4d56-ae66-88bcdaa9af9d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:44.343260 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4a406123-2e16-4d56-ae66-88bcdaa9af9d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:44.344056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4a406123-2e16-4d56-ae66-88bcdaa9af9d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:44.344885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4a406123-2e16-4d56-ae66-88bcdaa9af9d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:44.346342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4a406123-2e16-4d56-ae66-88bcdaa9af9d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:44.347267 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4a406123-2e16-4d56-ae66-88bcdaa9af9d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:44.348211 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4a406123-2e16-4d56-ae66-88bcdaa9af9d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:44.532421 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-4a406123-2e16-4d56-ae66-88bcdaa9af9d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:44.548710 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4a406123-2e16-4d56-ae66-88bcdaa9af9d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1503 microversion: 2.1 time: 0.216901 Sep 26 18:05:44.549671 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 140/273] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:44 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:45.028277 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9969f480-4395-4d4f-be83-511b58cb75e2 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:45.029723 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9969f480-4395-4d4f-be83-511b58cb75e2 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:45.040077 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9969f480-4395-4d4f-be83-511b58cb75e2 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:45.040987 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9969f480-4395-4d4f-be83-511b58cb75e2 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:45.041720 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9969f480-4395-4d4f-be83-511b58cb75e2 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:45.042811 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9969f480-4395-4d4f-be83-511b58cb75e2 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:45.043579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9969f480-4395-4d4f-be83-511b58cb75e2 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:45.044325 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9969f480-4395-4d4f-be83-511b58cb75e2 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:45.140267 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d2176beb-7e6d-4d5c-b35b-8519409630ca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:45.141231 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d2176beb-7e6d-4d5c-b35b-8519409630ca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:45.151475 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d2176beb-7e6d-4d5c-b35b-8519409630ca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:45.151999 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d2176beb-7e6d-4d5c-b35b-8519409630ca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:45.152818 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d2176beb-7e6d-4d5c-b35b-8519409630ca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:45.154232 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d2176beb-7e6d-4d5c-b35b-8519409630ca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:45.154859 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d2176beb-7e6d-4d5c-b35b-8519409630ca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:45.155447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d2176beb-7e6d-4d5c-b35b-8519409630ca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:45.358748 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d2176beb-7e6d-4d5c-b35b-8519409630ca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:45.375690 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d2176beb-7e6d-4d5c-b35b-8519409630ca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:45.379226 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d2176beb-7e6d-4d5c-b35b-8519409630ca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:45.382242 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d2176beb-7e6d-4d5c-b35b-8519409630ca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1286 microversion: 2.20 time: 0.246573 Sep 26 18:05:45.385463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 141/274] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:45 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1286 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:45.395802 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-fa144fd9-f356-45b7-9dc6-4db1751122b3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:45.397666 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-fa144fd9-f356-45b7-9dc6-4db1751122b3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:45.417927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa144fd9-f356-45b7-9dc6-4db1751122b3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:45.420228 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa144fd9-f356-45b7-9dc6-4db1751122b3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:45.421440 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa144fd9-f356-45b7-9dc6-4db1751122b3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:45.423634 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa144fd9-f356-45b7-9dc6-4db1751122b3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:45.425009 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa144fd9-f356-45b7-9dc6-4db1751122b3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:45.426015 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa144fd9-f356-45b7-9dc6-4db1751122b3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:45.460138 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9969f480-4395-4d4f-be83-511b58cb75e2 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:45.477840 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9969f480-4395-4d4f-be83-511b58cb75e2 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1314 microversion: 2.1 time: 0.458388 Sep 26 18:05:45.496855 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 134/275] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:45 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:45.581612 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ecc93cc9-4de3-4a6f-83e3-71efdcede81e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:45.582756 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ecc93cc9-4de3-4a6f-83e3-71efdcede81e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:45.590129 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ecc93cc9-4de3-4a6f-83e3-71efdcede81e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:45.590782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ecc93cc9-4de3-4a6f-83e3-71efdcede81e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:45.591332 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ecc93cc9-4de3-4a6f-83e3-71efdcede81e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:45.592203 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ecc93cc9-4de3-4a6f-83e3-71efdcede81e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:45.593034 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ecc93cc9-4de3-4a6f-83e3-71efdcede81e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:45.593703 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ecc93cc9-4de3-4a6f-83e3-71efdcede81e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:45.798390 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-fa144fd9-f356-45b7-9dc6-4db1751122b3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:45.816195 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-fa144fd9-f356-45b7-9dc6-4db1751122b3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1500 microversion: 2.1 time: 0.428421 Sep 26 18:05:45.817211 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 142/276] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:45 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1500 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:45.843063 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d0cec83a-83e0-4221-8652-1edd84967db5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3073dc0a-f558-47d1-9dd8-40fff239f1fb"}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:45.845888 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d0cec83a-83e0-4221-8652-1edd84967db5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:45.852746 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d0cec83a-83e0-4221-8652-1edd84967db5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:45.853241 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d0cec83a-83e0-4221-8652-1edd84967db5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:45.853678 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d0cec83a-83e0-4221-8652-1edd84967db5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:45.854394 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d0cec83a-83e0-4221-8652-1edd84967db5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:45.854850 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d0cec83a-83e0-4221-8652-1edd84967db5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:45.855497 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d0cec83a-83e0-4221-8652-1edd84967db5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:45.890995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-d0cec83a-83e0-4221-8652-1edd84967db5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] HTTP exception thrown: Cannot 'attach_volume' instance f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 while it is in vm_state rescued Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d0cec83a-83e0-4221-8652-1edd84967db5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Request method failure captured: Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: POST /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9/os-volume_attachments HTTP/1.1 Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 74 Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMelx-ipjEriwiSD7ibs9Z44BoWfZT3uyXwYPCzZ4uCB7LTqLOGaMmSnH6oOKtZayloye70yYnWFt5iXYcqgw8QZ2-eCL-Wz0unSbrK1_8M_uOgP8VNfV8jd2_jG5Mc5Zpq0az6KYot6uehZzTvsSYbg58zlBHSF8YA06MR56ri3H5AQ Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 3a15ebd862054a64ac1d739db5adc3a2 Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1906646791 Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:05:45.894004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:05:45.895549 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:05:45.895549 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1906646791 Sep 26 18:05:45.895549 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 3a15ebd862054a64ac1d739db5adc3a2 Sep 26 18:05:45.895549 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1906646791 Sep 26 18:05:45.895549 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-ServerRescueNegativeTestJSON-1906646791-project Sep 26 18:05:45.895549 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:05:45.895549 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:05:45.895549 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 97ed136f68c540abbdaf04cbe34a682e Sep 26 18:05:45.895549 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1906646791-project Sep 26 18:05:45.895549 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Sep 26 18:05:45.895549 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {"volumeAttachment": {"volumeId": "3073dc0a-f558-47d1-9dd8-40fff239f1fb"}} Sep 26 18:05:45.895549 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Cannot 'attach_volume' instance f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 while it is in vm_state rescued Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'server_id': 'f92dd8f8-d04b-4fb0-804a-8842bd4c60c9', 'body': {'volumeAttachment': {'volumeId': '3073dc0a-f558-47d1-9dd8-40fff239f1fb'}}} Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:05:45.896428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 while it is in vm_state rescued Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:45.898006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:45.899254 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:05:45.899254 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:05:45.899254 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 while it is in vm_state rescued Sep 26 18:05:45.899254 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:45.900548 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d0cec83a-83e0-4221-8652-1edd84967db5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Returning 409 to user: Cannot 'attach_volume' instance f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 while it is in vm_state rescued {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:05:45.901656 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d0cec83a-83e0-4221-8652-1edd84967db5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "POST /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.062846 Sep 26 18:05:45.907578 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 143/277] 10.222.0.67 () {60 vars in 1323 bytes} [Mon Sep 26 18:05:45 2022] POST /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9/os-volume_attachments => generated 152 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 26 18:05:45.914336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1c06b41a-bdf1-44f0-b548-d9ed5adac36c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:45.915084 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1c06b41a-bdf1-44f0-b548-d9ed5adac36c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:45.924868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c06b41a-bdf1-44f0-b548-d9ed5adac36c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:45.925891 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c06b41a-bdf1-44f0-b548-d9ed5adac36c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:45.926325 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c06b41a-bdf1-44f0-b548-d9ed5adac36c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:45.927799 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c06b41a-bdf1-44f0-b548-d9ed5adac36c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:45.928852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c06b41a-bdf1-44f0-b548-d9ed5adac36c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:45.929631 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c06b41a-bdf1-44f0-b548-d9ed5adac36c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:45.973636 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ecc93cc9-4de3-4a6f-83e3-71efdcede81e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:45.987638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ecc93cc9-4de3-4a6f-83e3-71efdcede81e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1503 microversion: 2.1 time: 0.410860 Sep 26 18:05:46.001862 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 135/278] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:45 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1503 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:46.357134 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-705b78b0-d6cb-48bf-8a33-2a7d453963a6 req-8957bf8a-8638-4e8f-bfec-1857f70de2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3f7652f-6765-4967-9ff6-f112a4b367e9", "name": "network-vif-deleted", "tag": "c786b600-af8e-47b7-8eb2-2b3abde7c6a6"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:46.394630 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1c06b41a-bdf1-44f0-b548-d9ed5adac36c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "POST /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9/action" status: 202 len: 0 microversion: 2.1 time: 0.484732 Sep 26 18:05:46.395578 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 144/279] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Sep 26 18:05:45 2022] POST /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:05:46.410804 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6ef4f93b-9340-4161-82a8-f753f1729f5b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:46.421595 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-6ef4f93b-9340-4161-82a8-f753f1729f5b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:46.430004 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-705b78b0-d6cb-48bf-8a33-2a7d453963a6 req-8957bf8a-8638-4e8f-bfec-1857f70de2e4 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:46.430004 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-705b78b0-d6cb-48bf-8a33-2a7d453963a6 req-8957bf8a-8638-4e8f-bfec-1857f70de2e4 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:46.430511 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-705b78b0-d6cb-48bf-8a33-2a7d453963a6 req-8957bf8a-8638-4e8f-bfec-1857f70de2e4 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:46.444023 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ef4f93b-9340-4161-82a8-f753f1729f5b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:46.447575 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ef4f93b-9340-4161-82a8-f753f1729f5b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:46.448727 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ef4f93b-9340-4161-82a8-f753f1729f5b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:46.450669 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ef4f93b-9340-4161-82a8-f753f1729f5b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:46.451934 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ef4f93b-9340-4161-82a8-f753f1729f5b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:46.457676 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ef4f93b-9340-4161-82a8-f753f1729f5b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:46.465561 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-705b78b0-d6cb-48bf-8a33-2a7d453963a6 req-8957bf8a-8638-4e8f-bfec-1857f70de2e4 service nova] Creating event network-vif-deleted:c786b600-af8e-47b7-8eb2-2b3abde7c6a6 for instance c3f7652f-6765-4967-9ff6-f112a4b367e9 on hv-cinder-85931 Sep 26 18:05:46.479401 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-705b78b0-d6cb-48bf-8a33-2a7d453963a6 req-8957bf8a-8638-4e8f-bfec-1857f70de2e4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125417 Sep 26 18:05:46.481326 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 136/280] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:05:46.494490 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-919ad910-189a-4c66-9bc7-e1a1f62190f9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:46.496873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-919ad910-189a-4c66-9bc7-e1a1f62190f9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:46.513379 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-919ad910-189a-4c66-9bc7-e1a1f62190f9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:46.514778 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-919ad910-189a-4c66-9bc7-e1a1f62190f9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:46.515481 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-919ad910-189a-4c66-9bc7-e1a1f62190f9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:46.518678 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-919ad910-189a-4c66-9bc7-e1a1f62190f9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:46.519791 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-919ad910-189a-4c66-9bc7-e1a1f62190f9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:46.525035 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-919ad910-189a-4c66-9bc7-e1a1f62190f9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:46.642182 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-919ad910-189a-4c66-9bc7-e1a1f62190f9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:46.656880 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-919ad910-189a-4c66-9bc7-e1a1f62190f9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:46.667535 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-919ad910-189a-4c66-9bc7-e1a1f62190f9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:46.670432 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-919ad910-189a-4c66-9bc7-e1a1f62190f9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1334 microversion: 2.20 time: 0.185259 Sep 26 18:05:46.671199 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 137/281] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:46 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1334 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:46.679472 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-690b56f2-4972-439b-841b-9d735efe6a94 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:46.681130 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-690b56f2-4972-439b-841b-9d735efe6a94 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:46.706927 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-690b56f2-4972-439b-841b-9d735efe6a94 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:46.707775 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-690b56f2-4972-439b-841b-9d735efe6a94 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:46.708929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-690b56f2-4972-439b-841b-9d735efe6a94 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:46.710210 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-690b56f2-4972-439b-841b-9d735efe6a94 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:46.711328 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-690b56f2-4972-439b-841b-9d735efe6a94 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:46.713311 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-690b56f2-4972-439b-841b-9d735efe6a94 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:46.767848 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6ef4f93b-9340-4161-82a8-f753f1729f5b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:46.780346 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-6ef4f93b-9340-4161-82a8-f753f1729f5b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1508 microversion: 2.1 time: 0.377267 Sep 26 18:05:46.785166 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 145/282] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:46 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1508 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:46.795181 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1592443335", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff0911ec-d0cb-47aa-9835-b96611526a51"}], "security_groups": [{"name": "tempest-securitygroup--203969854"}], "key_name": "tempest-keypair-1095959337", "user_data": "}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:47.067035 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-690b56f2-4972-439b-841b-9d735efe6a94 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:47.078223 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-690b56f2-4972-439b-841b-9d735efe6a94 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1314 microversion: 2.1 time: 0.405133 Sep 26 18:05:47.078907 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 138/283] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:46 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:47.099133 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-56d720a6-cedc-42cc-b7b2-9c98fa00923a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:47.105059 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-56d720a6-cedc-42cc-b7b2-9c98fa00923a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:47.114921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-56d720a6-cedc-42cc-b7b2-9c98fa00923a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:47.115483 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-56d720a6-cedc-42cc-b7b2-9c98fa00923a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:47.116207 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-56d720a6-cedc-42cc-b7b2-9c98fa00923a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:47.117501 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-56d720a6-cedc-42cc-b7b2-9c98fa00923a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:47.118349 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-56d720a6-cedc-42cc-b7b2-9c98fa00923a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:47.123533 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-56d720a6-cedc-42cc-b7b2-9c98fa00923a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:47.178785 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.network.neutron [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] validate_networks() for [('ff0911ec-d0cb-47aa-9835-b96611526a51', None, None, None, None, None)] {{(pid=121028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:05:47.251920 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-56d720a6-cedc-42cc-b7b2-9c98fa00923a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:47.265451 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-56d720a6-cedc-42cc-b7b2-9c98fa00923a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1298 microversion: 2.1 time: 0.184660 Sep 26 18:05:47.266698 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 139/284] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:47 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1298 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:47.711110 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d9d4973d-7b2c-4180-9aa0-4ccfd3a54923 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:47.712675 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d9d4973d-7b2c-4180-9aa0-4ccfd3a54923 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:47.731636 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d9d4973d-7b2c-4180-9aa0-4ccfd3a54923 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:47.732192 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d9d4973d-7b2c-4180-9aa0-4ccfd3a54923 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:47.732922 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d9d4973d-7b2c-4180-9aa0-4ccfd3a54923 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:47.733857 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d9d4973d-7b2c-4180-9aa0-4ccfd3a54923 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:47.739713 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d9d4973d-7b2c-4180-9aa0-4ccfd3a54923 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:47.739713 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d9d4973d-7b2c-4180-9aa0-4ccfd3a54923 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:47.886865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d9d4973d-7b2c-4180-9aa0-4ccfd3a54923 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:47.919530 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d9d4973d-7b2c-4180-9aa0-4ccfd3a54923 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:47.924115 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d9d4973d-7b2c-4180-9aa0-4ccfd3a54923 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:47.928812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d9d4973d-7b2c-4180-9aa0-4ccfd3a54923 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1334 microversion: 2.20 time: 0.220324 Sep 26 18:05:47.928979 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 140/285] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:47 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1334 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:47.938835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d38b356f-49a8-441e-b6e4-70db67483a55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:47.941179 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d38b356f-49a8-441e-b6e4-70db67483a55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:47.952083 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d38b356f-49a8-441e-b6e4-70db67483a55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:47.955385 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d38b356f-49a8-441e-b6e4-70db67483a55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:47.956416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d38b356f-49a8-441e-b6e4-70db67483a55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:47.957723 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d38b356f-49a8-441e-b6e4-70db67483a55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:47.958595 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d38b356f-49a8-441e-b6e4-70db67483a55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:47.961716 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d38b356f-49a8-441e-b6e4-70db67483a55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:48.050402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Flavor limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:05:48.050928 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Image limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:05:48.051520 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Flavor pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:05:48.052219 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Image pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:05:48.052974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:05:48.067114 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:48.068124 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:48.068744 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:48.069609 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:48.070165 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:48.070725 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:48.101619 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Getting quotas for project ffa58ff5197e48709d5c90ec334b9403. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:05:48.108016 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Getting quotas for user 0bede3a601f941e7abc9fd16983679b2 and project ffa58ff5197e48709d5c90ec334b9403. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:05:48.132123 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Going to run 1 instances... {{(pid=121028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:05:48.138156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:05:48.205567 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d38b356f-49a8-441e-b6e4-70db67483a55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:48.223203 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d38b356f-49a8-441e-b6e4-70db67483a55 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1508 microversion: 2.1 time: 0.292675 Sep 26 18:05:48.227897 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 141/286] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:47 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1508 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:48.236929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7345ed94-6b4f-473d-9ed8-c6845d958524 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:48.238193 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7345ed94-6b4f-473d-9ed8-c6845d958524 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:48.249354 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7345ed94-6b4f-473d-9ed8-c6845d958524 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:48.250208 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7345ed94-6b4f-473d-9ed8-c6845d958524 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:48.251592 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7345ed94-6b4f-473d-9ed8-c6845d958524 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:48.253087 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7345ed94-6b4f-473d-9ed8-c6845d958524 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:48.253911 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7345ed94-6b4f-473d-9ed8-c6845d958524 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:48.254844 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7345ed94-6b4f-473d-9ed8-c6845d958524 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:48.322926 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-78183ba4-9e03-4160-bfab-00b242f17e2a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.536080 Sep 26 18:05:48.324372 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 146/287] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:05:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:05:48.337255 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-83963d31-547c-4fbc-bb87-a58a046bb217 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:48.338607 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-83963d31-547c-4fbc-bb87-a58a046bb217 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:48.352995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83963d31-547c-4fbc-bb87-a58a046bb217 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:48.353968 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83963d31-547c-4fbc-bb87-a58a046bb217 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:48.356152 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83963d31-547c-4fbc-bb87-a58a046bb217 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:48.357696 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83963d31-547c-4fbc-bb87-a58a046bb217 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:48.360352 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83963d31-547c-4fbc-bb87-a58a046bb217 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:48.366234 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83963d31-547c-4fbc-bb87-a58a046bb217 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:48.423940 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83963d31-547c-4fbc-bb87-a58a046bb217 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:48.423940 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83963d31-547c-4fbc-bb87-a58a046bb217 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:48.423940 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83963d31-547c-4fbc-bb87-a58a046bb217 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:48.423940 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-83963d31-547c-4fbc-bb87-a58a046bb217 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lazy-loading 'fault' on Instance uuid c3f7652f-6765-4967-9ff6-f112a4b367e9 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:05:48.548860 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-83963d31-547c-4fbc-bb87-a58a046bb217 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:48.560484 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-83963d31-547c-4fbc-bb87-a58a046bb217 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1303 microversion: 2.1 time: 0.233496 Sep 26 18:05:48.561969 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 147/288] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:48 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1303 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:48.576371 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-804cc295-1d3d-4946-96e3-0052f571ab80 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:48.577502 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-804cc295-1d3d-4946-96e3-0052f571ab80 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:48.661987 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7345ed94-6b4f-473d-9ed8-c6845d958524 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:48.667197 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-804cc295-1d3d-4946-96e3-0052f571ab80 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:48.670834 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-804cc295-1d3d-4946-96e3-0052f571ab80 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1242 microversion: 2.1 time: 0.104968 Sep 26 18:05:48.671814 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 148/289] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:48 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1242 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:48.691477 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7345ed94-6b4f-473d-9ed8-c6845d958524 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1464 microversion: 2.1 time: 0.461532 Sep 26 18:05:48.692499 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 142/290] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:48 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1464 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:48.787849 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-33655718-8637-4c5e-a396-8083e2c8730f tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:48.788359 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-33655718-8637-4c5e-a396-8083e2c8730f tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:48.805439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-33655718-8637-4c5e-a396-8083e2c8730f tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:48.806518 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-33655718-8637-4c5e-a396-8083e2c8730f tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:48.807293 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-33655718-8637-4c5e-a396-8083e2c8730f tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:48.808662 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-33655718-8637-4c5e-a396-8083e2c8730f tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:48.809464 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-33655718-8637-4c5e-a396-8083e2c8730f tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:48.810389 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-33655718-8637-4c5e-a396-8083e2c8730f tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:48.859845 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-33655718-8637-4c5e-a396-8083e2c8730f tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Going to try to terminate instance {{(pid=121028) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:05:48.968079 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ad18efec-dc05-4cd0-9cf6-a4af8f808cec tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:48.968857 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ad18efec-dc05-4cd0-9cf6-a4af8f808cec tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:48.990286 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad18efec-dc05-4cd0-9cf6-a4af8f808cec tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:48.990747 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad18efec-dc05-4cd0-9cf6-a4af8f808cec tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:48.991351 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad18efec-dc05-4cd0-9cf6-a4af8f808cec tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:48.996342 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad18efec-dc05-4cd0-9cf6-a4af8f808cec tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:48.997185 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad18efec-dc05-4cd0-9cf6-a4af8f808cec tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:48.997985 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ad18efec-dc05-4cd0-9cf6-a4af8f808cec tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:49.230434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ad18efec-dc05-4cd0-9cf6-a4af8f808cec tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:49.248543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ad18efec-dc05-4cd0-9cf6-a4af8f808cec tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:49.251617 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ad18efec-dc05-4cd0-9cf6-a4af8f808cec tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:49.265726 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ad18efec-dc05-4cd0-9cf6-a4af8f808cec tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1342 microversion: 2.20 time: 0.296038 Sep 26 18:05:49.279792 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 143/291] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:48 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1342 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:05:49.305590 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ee844eab-a2ac-4d84-bb76-0c6458abdf7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:49.318080 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ee844eab-a2ac-4d84-bb76-0c6458abdf7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:49.326578 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ee844eab-a2ac-4d84-bb76-0c6458abdf7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:49.327564 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ee844eab-a2ac-4d84-bb76-0c6458abdf7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:49.328306 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ee844eab-a2ac-4d84-bb76-0c6458abdf7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:49.330007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ee844eab-a2ac-4d84-bb76-0c6458abdf7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:49.330802 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ee844eab-a2ac-4d84-bb76-0c6458abdf7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:49.332073 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ee844eab-a2ac-4d84-bb76-0c6458abdf7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:49.337627 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:49.514510 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-33655718-8637-4c5e-a396-8083e2c8730f tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "DELETE /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 204 len: 0 microversion: 2.1 time: 0.730197 Sep 26 18:05:49.515288 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 149/292] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:05:48 2022] DELETE /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 0 bytes in 732 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:05:49.532752 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2dc44b8c-ea52-4434-8930-fdae88b470c5 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:49.534449 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2dc44b8c-ea52-4434-8930-fdae88b470c5 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:49.536656 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ee844eab-a2ac-4d84-bb76-0c6458abdf7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:49.541431 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2dc44b8c-ea52-4434-8930-fdae88b470c5 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:49.542012 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2dc44b8c-ea52-4434-8930-fdae88b470c5 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:49.542365 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2dc44b8c-ea52-4434-8930-fdae88b470c5 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:49.543097 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2dc44b8c-ea52-4434-8930-fdae88b470c5 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:49.543779 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2dc44b8c-ea52-4434-8930-fdae88b470c5 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:49.544202 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2dc44b8c-ea52-4434-8930-fdae88b470c5 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:49.546418 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ee844eab-a2ac-4d84-bb76-0c6458abdf7b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1508 microversion: 2.1 time: 0.264920 Sep 26 18:05:49.547105 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 144/293] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:49 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:49.585949 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7ddfd97c-ac81-4be4-a08a-cc72dfd862d5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:49.586559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7ddfd97c-ac81-4be4-a08a-cc72dfd862d5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:49.593383 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7ddfd97c-ac81-4be4-a08a-cc72dfd862d5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:49.593889 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7ddfd97c-ac81-4be4-a08a-cc72dfd862d5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:49.594959 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7ddfd97c-ac81-4be4-a08a-cc72dfd862d5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:49.595960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7ddfd97c-ac81-4be4-a08a-cc72dfd862d5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:49.596764 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7ddfd97c-ac81-4be4-a08a-cc72dfd862d5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:49.597183 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7ddfd97c-ac81-4be4-a08a-cc72dfd862d5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:49.667670 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7ddfd97c-ac81-4be4-a08a-cc72dfd862d5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:49.668836 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7ddfd97c-ac81-4be4-a08a-cc72dfd862d5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:49.670290 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7ddfd97c-ac81-4be4-a08a-cc72dfd862d5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:49.671053 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-7ddfd97c-ac81-4be4-a08a-cc72dfd862d5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lazy-loading 'fault' on Instance uuid c3f7652f-6765-4967-9ff6-f112a4b367e9 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:05:49.783732 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7ddfd97c-ac81-4be4-a08a-cc72dfd862d5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:49.790369 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=100 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:49.801822 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7ddfd97c-ac81-4be4-a08a-cc72dfd862d5 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1303 microversion: 2.1 time: 0.219492 Sep 26 18:05:49.803231 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 145/294] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:49 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1303 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:49.811330 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-78075e6a-be01-4f4d-afe0-93cec340a174 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:49.814039 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-78075e6a-be01-4f4d-afe0-93cec340a174 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:49.930410 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2dc44b8c-ea52-4434-8930-fdae88b470c5 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:49.961369 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2dc44b8c-ea52-4434-8930-fdae88b470c5 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1470 microversion: 2.1 time: 0.439651 Sep 26 18:05:49.963044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 150/295] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:49 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1470 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:49.970212 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-78075e6a-be01-4f4d-afe0-93cec340a174 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:49.995174 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-78075e6a-be01-4f4d-afe0-93cec340a174 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1242 microversion: 2.1 time: 0.189571 Sep 26 18:05:49.997259 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 146/296] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:49 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1242 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:50.328117 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f1022f55-22d0-42f0-b945-93f0c6007976 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:50.329398 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f1022f55-22d0-42f0-b945-93f0c6007976 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:50.338905 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1022f55-22d0-42f0-b945-93f0c6007976 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:50.344577 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1022f55-22d0-42f0-b945-93f0c6007976 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:50.344577 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1022f55-22d0-42f0-b945-93f0c6007976 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:50.344577 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1022f55-22d0-42f0-b945-93f0c6007976 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:50.344577 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1022f55-22d0-42f0-b945-93f0c6007976 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:50.345471 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1022f55-22d0-42f0-b945-93f0c6007976 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:50.441819 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f1022f55-22d0-42f0-b945-93f0c6007976 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:50.450977 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f1022f55-22d0-42f0-b945-93f0c6007976 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:50.452475 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f1022f55-22d0-42f0-b945-93f0c6007976 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:50.454423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f1022f55-22d0-42f0-b945-93f0c6007976 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1340 microversion: 2.20 time: 0.132078 Sep 26 18:05:50.455544 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 151/297] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:50 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1340 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:50.582180 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5cfa7413-7955-4547-8636-278233ca5858 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:50.582704 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-5cfa7413-7955-4547-8636-278233ca5858 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:50.588757 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cfa7413-7955-4547-8636-278233ca5858 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:50.589244 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cfa7413-7955-4547-8636-278233ca5858 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:50.589683 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cfa7413-7955-4547-8636-278233ca5858 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:50.590382 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cfa7413-7955-4547-8636-278233ca5858 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:50.590841 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cfa7413-7955-4547-8636-278233ca5858 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:50.591269 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cfa7413-7955-4547-8636-278233ca5858 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:50.733400 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5cfa7413-7955-4547-8636-278233ca5858 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:50.745172 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5cfa7413-7955-4547-8636-278233ca5858 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1508 microversion: 2.1 time: 0.168279 Sep 26 18:05:50.751508 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 147/298] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:50 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:50.841413 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2da5fc6d-369a-4053-8fa2-f83ba54909cb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:50.841935 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2da5fc6d-369a-4053-8fa2-f83ba54909cb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:50.850044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2da5fc6d-369a-4053-8fa2-f83ba54909cb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:50.850532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2da5fc6d-369a-4053-8fa2-f83ba54909cb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:50.850985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2da5fc6d-369a-4053-8fa2-f83ba54909cb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:50.851707 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2da5fc6d-369a-4053-8fa2-f83ba54909cb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:50.852163 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2da5fc6d-369a-4053-8fa2-f83ba54909cb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:50.852585 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2da5fc6d-369a-4053-8fa2-f83ba54909cb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:50.887443 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2da5fc6d-369a-4053-8fa2-f83ba54909cb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:50.887956 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2da5fc6d-369a-4053-8fa2-f83ba54909cb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:50.888390 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2da5fc6d-369a-4053-8fa2-f83ba54909cb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:50.888834 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-2da5fc6d-369a-4053-8fa2-f83ba54909cb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lazy-loading 'fault' on Instance uuid c3f7652f-6765-4967-9ff6-f112a4b367e9 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:05:50.931761 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2da5fc6d-369a-4053-8fa2-f83ba54909cb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:50.940410 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2da5fc6d-369a-4053-8fa2-f83ba54909cb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1303 microversion: 2.1 time: 0.103615 Sep 26 18:05:50.940973 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 152/299] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:50 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:51.016056 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f2f073e4-6ff6-4334-a030-82502c163435 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:51.017596 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f2f073e4-6ff6-4334-a030-82502c163435 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:51.024566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f2f073e4-6ff6-4334-a030-82502c163435 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:51.025061 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f2f073e4-6ff6-4334-a030-82502c163435 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:51.025500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f2f073e4-6ff6-4334-a030-82502c163435 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:51.026211 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f2f073e4-6ff6-4334-a030-82502c163435 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:51.026666 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f2f073e4-6ff6-4334-a030-82502c163435 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:51.027202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f2f073e4-6ff6-4334-a030-82502c163435 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:51.030904 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3995985f-e285-4eaa-9dfb-fde04d90df88 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:51.032426 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-3995985f-e285-4eaa-9dfb-fde04d90df88 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:51.041032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3995985f-e285-4eaa-9dfb-fde04d90df88 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:51.041760 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3995985f-e285-4eaa-9dfb-fde04d90df88 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:51.042408 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3995985f-e285-4eaa-9dfb-fde04d90df88 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:51.043575 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3995985f-e285-4eaa-9dfb-fde04d90df88 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:51.044177 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3995985f-e285-4eaa-9dfb-fde04d90df88 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:51.044870 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3995985f-e285-4eaa-9dfb-fde04d90df88 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:51.134700 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3995985f-e285-4eaa-9dfb-fde04d90df88 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:51.143683 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-3995985f-e285-4eaa-9dfb-fde04d90df88 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1246 microversion: 2.1 time: 0.118800 Sep 26 18:05:51.144235 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 153/300] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:51 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1246 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:51.209971 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f2f073e4-6ff6-4334-a030-82502c163435 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:51.218868 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f2f073e4-6ff6-4334-a030-82502c163435 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1470 microversion: 2.1 time: 0.206803 Sep 26 18:05:51.219555 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 148/301] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:51 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:51.480321 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d890f4ac-c507-417d-b8cd-8c5ab863b4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:51.480911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d890f4ac-c507-417d-b8cd-8c5ab863b4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:51.488512 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d890f4ac-c507-417d-b8cd-8c5ab863b4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:51.489008 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d890f4ac-c507-417d-b8cd-8c5ab863b4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:51.489441 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d890f4ac-c507-417d-b8cd-8c5ab863b4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:51.490146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d890f4ac-c507-417d-b8cd-8c5ab863b4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:51.490600 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d890f4ac-c507-417d-b8cd-8c5ab863b4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:51.491023 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d890f4ac-c507-417d-b8cd-8c5ab863b4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:51.565574 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d890f4ac-c507-417d-b8cd-8c5ab863b4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:51.569804 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:51.576968 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d890f4ac-c507-417d-b8cd-8c5ab863b4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:51.578412 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d890f4ac-c507-417d-b8cd-8c5ab863b4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:51.579879 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d890f4ac-c507-417d-b8cd-8c5ab863b4b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1340 microversion: 2.20 time: 0.103310 Sep 26 18:05:51.580824 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 154/302] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:51 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1340 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:51.771471 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-704f31fb-3e32-4f9e-9e0a-1327ff903de3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:51.772139 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-704f31fb-3e32-4f9e-9e0a-1327ff903de3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:51.778338 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-704f31fb-3e32-4f9e-9e0a-1327ff903de3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:51.778820 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-704f31fb-3e32-4f9e-9e0a-1327ff903de3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:51.779253 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-704f31fb-3e32-4f9e-9e0a-1327ff903de3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:51.779978 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-704f31fb-3e32-4f9e-9e0a-1327ff903de3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:51.780437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-704f31fb-3e32-4f9e-9e0a-1327ff903de3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:51.780857 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-704f31fb-3e32-4f9e-9e0a-1327ff903de3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:51.942183 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-704f31fb-3e32-4f9e-9e0a-1327ff903de3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:51.942183 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-704f31fb-3e32-4f9e-9e0a-1327ff903de3 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1508 microversion: 2.1 time: 0.172427 Sep 26 18:05:51.942183 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 149/303] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:51 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:51.964395 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-40900475-5f4d-47ed-b7d0-cfa4b0c6ea7f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:51.964973 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-40900475-5f4d-47ed-b7d0-cfa4b0c6ea7f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:51.972054 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-40900475-5f4d-47ed-b7d0-cfa4b0c6ea7f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:51.972533 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-40900475-5f4d-47ed-b7d0-cfa4b0c6ea7f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:51.973156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-40900475-5f4d-47ed-b7d0-cfa4b0c6ea7f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:51.973875 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-40900475-5f4d-47ed-b7d0-cfa4b0c6ea7f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:51.974323 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-40900475-5f4d-47ed-b7d0-cfa4b0c6ea7f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:51.974963 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-40900475-5f4d-47ed-b7d0-cfa4b0c6ea7f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:52.030117 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-40900475-5f4d-47ed-b7d0-cfa4b0c6ea7f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:52.030434 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-40900475-5f4d-47ed-b7d0-cfa4b0c6ea7f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:52.030859 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-40900475-5f4d-47ed-b7d0-cfa4b0c6ea7f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:52.031487 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-40900475-5f4d-47ed-b7d0-cfa4b0c6ea7f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lazy-loading 'fault' on Instance uuid c3f7652f-6765-4967-9ff6-f112a4b367e9 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:05:52.085494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-40900475-5f4d-47ed-b7d0-cfa4b0c6ea7f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:52.093306 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-40900475-5f4d-47ed-b7d0-cfa4b0c6ea7f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1303 microversion: 2.1 time: 0.132818 Sep 26 18:05:52.093884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 155/304] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:51 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1303 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:52.167924 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bf6e151c-cb20-48ad-a6e7-edbd4ea5a92e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:52.168596 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-bf6e151c-cb20-48ad-a6e7-edbd4ea5a92e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:52.176379 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bf6e151c-cb20-48ad-a6e7-edbd4ea5a92e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:52.178503 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bf6e151c-cb20-48ad-a6e7-edbd4ea5a92e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:52.178503 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bf6e151c-cb20-48ad-a6e7-edbd4ea5a92e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:52.178503 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bf6e151c-cb20-48ad-a6e7-edbd4ea5a92e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:52.178503 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bf6e151c-cb20-48ad-a6e7-edbd4ea5a92e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:52.178995 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bf6e151c-cb20-48ad-a6e7-edbd4ea5a92e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:52.246269 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bf6e151c-cb20-48ad-a6e7-edbd4ea5a92e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:52.248750 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6b58de04-6a18-43bc-91da-0aeda00b95ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:52.249356 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-6b58de04-6a18-43bc-91da-0aeda00b95ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:52.254583 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bf6e151c-cb20-48ad-a6e7-edbd4ea5a92e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1246 microversion: 2.1 time: 0.091428 Sep 26 18:05:52.255160 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 150/305] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:52 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:52.258038 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6b58de04-6a18-43bc-91da-0aeda00b95ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:52.258921 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6b58de04-6a18-43bc-91da-0aeda00b95ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:52.260052 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6b58de04-6a18-43bc-91da-0aeda00b95ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:52.261270 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6b58de04-6a18-43bc-91da-0aeda00b95ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:52.262104 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6b58de04-6a18-43bc-91da-0aeda00b95ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:52.262997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6b58de04-6a18-43bc-91da-0aeda00b95ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:52.426914 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6b58de04-6a18-43bc-91da-0aeda00b95ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:52.437501 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-6b58de04-6a18-43bc-91da-0aeda00b95ca tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1470 microversion: 2.1 time: 0.193053 Sep 26 18:05:52.438122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 156/306] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:52 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:52.607819 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ffa40e2d-b347-4714-bdcf-154ef0462e1a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:52.608483 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ffa40e2d-b347-4714-bdcf-154ef0462e1a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:52.615410 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ffa40e2d-b347-4714-bdcf-154ef0462e1a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:52.615952 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ffa40e2d-b347-4714-bdcf-154ef0462e1a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:52.616394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ffa40e2d-b347-4714-bdcf-154ef0462e1a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:52.617098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ffa40e2d-b347-4714-bdcf-154ef0462e1a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:52.617555 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ffa40e2d-b347-4714-bdcf-154ef0462e1a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:52.617981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ffa40e2d-b347-4714-bdcf-154ef0462e1a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:52.696160 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ffa40e2d-b347-4714-bdcf-154ef0462e1a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:52.709058 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ffa40e2d-b347-4714-bdcf-154ef0462e1a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:52.710519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ffa40e2d-b347-4714-bdcf-154ef0462e1a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:52.711632 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ffa40e2d-b347-4714-bdcf-154ef0462e1a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1340 microversion: 2.20 time: 0.108772 Sep 26 18:05:52.712210 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 151/307] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:52 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1340 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:52.965555 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-aec1702c-6d86-442c-a200-1af99f383987 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:52.966439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-aec1702c-6d86-442c-a200-1af99f383987 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:52.972874 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-aec1702c-6d86-442c-a200-1af99f383987 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:52.973420 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-aec1702c-6d86-442c-a200-1af99f383987 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:52.973858 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-aec1702c-6d86-442c-a200-1af99f383987 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:52.974560 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-aec1702c-6d86-442c-a200-1af99f383987 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:52.975022 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-aec1702c-6d86-442c-a200-1af99f383987 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:52.975454 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-aec1702c-6d86-442c-a200-1af99f383987 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:53.121326 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-93046767-4de6-44f2-ad5c-2532e9e29093 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:53.122636 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-93046767-4de6-44f2-ad5c-2532e9e29093 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:53.130508 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-aec1702c-6d86-442c-a200-1af99f383987 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:53.141079 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93046767-4de6-44f2-ad5c-2532e9e29093 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:53.142184 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93046767-4de6-44f2-ad5c-2532e9e29093 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:53.142918 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93046767-4de6-44f2-ad5c-2532e9e29093 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:53.144459 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93046767-4de6-44f2-ad5c-2532e9e29093 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:53.144459 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93046767-4de6-44f2-ad5c-2532e9e29093 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:53.145745 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93046767-4de6-44f2-ad5c-2532e9e29093 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:53.146131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-aec1702c-6d86-442c-a200-1af99f383987 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1508 microversion: 2.1 time: 0.184967 Sep 26 18:05:53.147497 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 157/308] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:52 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:53.202655 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93046767-4de6-44f2-ad5c-2532e9e29093 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:53.203251 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93046767-4de6-44f2-ad5c-2532e9e29093 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:53.203640 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93046767-4de6-44f2-ad5c-2532e9e29093 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:53.204141 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-93046767-4de6-44f2-ad5c-2532e9e29093 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lazy-loading 'fault' on Instance uuid c3f7652f-6765-4967-9ff6-f112a4b367e9 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:05:53.254237 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-93046767-4de6-44f2-ad5c-2532e9e29093 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:53.263314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-93046767-4de6-44f2-ad5c-2532e9e29093 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1303 microversion: 2.1 time: 0.149112 Sep 26 18:05:53.264079 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 152/309] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:53 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1303 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:53.280642 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ed96ba20-a2ba-4f23-8c54-1d566b57327b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:53.281257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ed96ba20-a2ba-4f23-8c54-1d566b57327b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:53.288570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ed96ba20-a2ba-4f23-8c54-1d566b57327b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:53.289270 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ed96ba20-a2ba-4f23-8c54-1d566b57327b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:53.289708 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ed96ba20-a2ba-4f23-8c54-1d566b57327b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:53.290506 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ed96ba20-a2ba-4f23-8c54-1d566b57327b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:53.291521 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ed96ba20-a2ba-4f23-8c54-1d566b57327b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:53.291987 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ed96ba20-a2ba-4f23-8c54-1d566b57327b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:53.359773 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ed96ba20-a2ba-4f23-8c54-1d566b57327b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:53.370454 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ed96ba20-a2ba-4f23-8c54-1d566b57327b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1246 microversion: 2.1 time: 0.095239 Sep 26 18:05:53.372234 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 158/310] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:53 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:53.462067 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-6b6a6982-5f0c-4a7f-bbb1-3ccf0d0a079c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:53.462700 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-6b6a6982-5f0c-4a7f-bbb1-3ccf0d0a079c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:53.471124 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6b6a6982-5f0c-4a7f-bbb1-3ccf0d0a079c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:53.471767 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6b6a6982-5f0c-4a7f-bbb1-3ccf0d0a079c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:53.478100 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6b6a6982-5f0c-4a7f-bbb1-3ccf0d0a079c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:53.478100 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6b6a6982-5f0c-4a7f-bbb1-3ccf0d0a079c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:53.478100 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6b6a6982-5f0c-4a7f-bbb1-3ccf0d0a079c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:53.478100 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6b6a6982-5f0c-4a7f-bbb1-3ccf0d0a079c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:53.711619 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-6b6a6982-5f0c-4a7f-bbb1-3ccf0d0a079c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:53.720645 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-6b6a6982-5f0c-4a7f-bbb1-3ccf0d0a079c tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1470 microversion: 2.1 time: 0.262582 Sep 26 18:05:53.721220 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 153/311] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:53 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1470 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:53.740639 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d69d449f-2eab-4102-b5f3-80268c4f7c07 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:53.741367 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d69d449f-2eab-4102-b5f3-80268c4f7c07 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:53.747891 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d69d449f-2eab-4102-b5f3-80268c4f7c07 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:53.748454 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d69d449f-2eab-4102-b5f3-80268c4f7c07 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:53.748808 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d69d449f-2eab-4102-b5f3-80268c4f7c07 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:53.749520 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d69d449f-2eab-4102-b5f3-80268c4f7c07 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:53.750149 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d69d449f-2eab-4102-b5f3-80268c4f7c07 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:53.751044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d69d449f-2eab-4102-b5f3-80268c4f7c07 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:53.828403 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d69d449f-2eab-4102-b5f3-80268c4f7c07 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:53.837642 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d69d449f-2eab-4102-b5f3-80268c4f7c07 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:53.839474 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d69d449f-2eab-4102-b5f3-80268c4f7c07 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:53.840891 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d69d449f-2eab-4102-b5f3-80268c4f7c07 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1340 microversion: 2.20 time: 0.105753 Sep 26 18:05:53.841710 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 159/312] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:53 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1340 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:54.173439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e0cc8a5e-526d-4f57-a0f8-35d11431c7f1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:54.173949 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e0cc8a5e-526d-4f57-a0f8-35d11431c7f1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:54.181380 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0cc8a5e-526d-4f57-a0f8-35d11431c7f1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:54.182230 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0cc8a5e-526d-4f57-a0f8-35d11431c7f1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:54.182885 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0cc8a5e-526d-4f57-a0f8-35d11431c7f1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:54.183821 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0cc8a5e-526d-4f57-a0f8-35d11431c7f1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:54.184562 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0cc8a5e-526d-4f57-a0f8-35d11431c7f1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:54.185181 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0cc8a5e-526d-4f57-a0f8-35d11431c7f1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:54.310160 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-919e0458-0549-4dcb-a4bb-b0f06a7ee6eb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:54.311342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-919e0458-0549-4dcb-a4bb-b0f06a7ee6eb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:54.333592 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-919e0458-0549-4dcb-a4bb-b0f06a7ee6eb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:54.334342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-919e0458-0549-4dcb-a4bb-b0f06a7ee6eb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:54.334954 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-919e0458-0549-4dcb-a4bb-b0f06a7ee6eb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:54.335935 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-919e0458-0549-4dcb-a4bb-b0f06a7ee6eb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:54.336592 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-919e0458-0549-4dcb-a4bb-b0f06a7ee6eb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:54.337206 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-919e0458-0549-4dcb-a4bb-b0f06a7ee6eb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:54.397104 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-919e0458-0549-4dcb-a4bb-b0f06a7ee6eb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:54.397895 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-919e0458-0549-4dcb-a4bb-b0f06a7ee6eb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:54.398558 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-919e0458-0549-4dcb-a4bb-b0f06a7ee6eb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:54.399631 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-919e0458-0549-4dcb-a4bb-b0f06a7ee6eb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lazy-loading 'fault' on Instance uuid c3f7652f-6765-4967-9ff6-f112a4b367e9 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:05:54.570818 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-919e0458-0549-4dcb-a4bb-b0f06a7ee6eb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:54.587182 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-919e0458-0549-4dcb-a4bb-b0f06a7ee6eb tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 200 len: 1303 microversion: 2.1 time: 0.284882 Sep 26 18:05:54.588283 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 160/313] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:54 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 1303 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:54.604351 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-28e80295-4e3c-4471-8d96-4a0d216b212a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:54.609021 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-28e80295-4e3c-4471-8d96-4a0d216b212a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:54.617484 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-28e80295-4e3c-4471-8d96-4a0d216b212a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:54.618197 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-28e80295-4e3c-4471-8d96-4a0d216b212a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:54.618651 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-28e80295-4e3c-4471-8d96-4a0d216b212a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:54.620078 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-28e80295-4e3c-4471-8d96-4a0d216b212a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:54.620929 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-28e80295-4e3c-4471-8d96-4a0d216b212a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:54.621655 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-28e80295-4e3c-4471-8d96-4a0d216b212a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:54.752780 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-28e80295-4e3c-4471-8d96-4a0d216b212a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:54.755442 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e0cc8a5e-526d-4f57-a0f8-35d11431c7f1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:54.784663 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e0cc8a5e-526d-4f57-a0f8-35d11431c7f1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1508 microversion: 2.1 time: 0.604708 Sep 26 18:05:54.784663 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 154/314] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:54 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1508 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:05:54.790328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-28e80295-4e3c-4471-8d96-4a0d216b212a tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1246 microversion: 2.1 time: 0.200029 Sep 26 18:05:54.793469 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 161/315] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:54 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1246 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:54.814332 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-3acd91a2-d397-49f8-b81d-b67ef67f25ed tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:54.815611 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3acd91a2-d397-49f8-b81d-b67ef67f25ed tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:54.828287 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3acd91a2-d397-49f8-b81d-b67ef67f25ed tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:54.829752 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3acd91a2-d397-49f8-b81d-b67ef67f25ed tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:54.830558 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3acd91a2-d397-49f8-b81d-b67ef67f25ed tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:54.831668 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3acd91a2-d397-49f8-b81d-b67ef67f25ed tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:54.832396 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3acd91a2-d397-49f8-b81d-b67ef67f25ed tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:54.833161 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3acd91a2-d397-49f8-b81d-b67ef67f25ed tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:54.894245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-143154db-c37b-46cb-b2a5-19db6812700e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:54.896110 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-143154db-c37b-46cb-b2a5-19db6812700e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:54.907170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-143154db-c37b-46cb-b2a5-19db6812700e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:54.908275 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-143154db-c37b-46cb-b2a5-19db6812700e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:54.909147 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-143154db-c37b-46cb-b2a5-19db6812700e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:54.910639 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-143154db-c37b-46cb-b2a5-19db6812700e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:54.911578 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-143154db-c37b-46cb-b2a5-19db6812700e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:54.912912 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-143154db-c37b-46cb-b2a5-19db6812700e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:55.000845 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-143154db-c37b-46cb-b2a5-19db6812700e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:55.012355 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-143154db-c37b-46cb-b2a5-19db6812700e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:55.013967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-143154db-c37b-46cb-b2a5-19db6812700e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:55.015378 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-143154db-c37b-46cb-b2a5-19db6812700e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1340 microversion: 2.20 time: 0.137676 Sep 26 18:05:55.016429 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 162/316] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:54 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1340 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:55.194919 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3acd91a2-d397-49f8-b81d-b67ef67f25ed tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:55.208710 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-3acd91a2-d397-49f8-b81d-b67ef67f25ed tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1470 microversion: 2.1 time: 0.431338 Sep 26 18:05:55.224089 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 155/317] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:54 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1470 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:55.613699 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-626c7082-5896-47c0-a952-cbadc4ecb6cf tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:55.614245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-626c7082-5896-47c0-a952-cbadc4ecb6cf tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: c3f7652f-6765-4967-9ff6-f112a4b367e9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:55.621062 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-626c7082-5896-47c0-a952-cbadc4ecb6cf tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:55.621560 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-626c7082-5896-47c0-a952-cbadc4ecb6cf tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:55.622071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-626c7082-5896-47c0-a952-cbadc4ecb6cf tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:55.622776 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-626c7082-5896-47c0-a952-cbadc4ecb6cf tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:55.623230 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-626c7082-5896-47c0-a952-cbadc4ecb6cf tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:55.623789 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-626c7082-5896-47c0-a952-cbadc4ecb6cf tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:55.638374 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-626c7082-5896-47c0-a952-cbadc4ecb6cf tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] HTTP exception thrown: Instance c3f7652f-6765-4967-9ff6-f112a4b367e9 could not be found. Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-626c7082-5896-47c0-a952-cbadc4ecb6cf tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Request method failure captured: Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 HTTP/1.1 Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMenPpBL2nBIMHft39K-M5houcBmP-Pv3AOwXsrNCtarL-jC0Wm9t9q8JRzsKok5OGa1Akhr4fG3JLF1LBqWFvNLO_gfR119vKwfH0lfguIg7c9f-F-prFm_wKSwm5XgvOyzL_oLDja-L8eh1W22tH2Za66MvdU6AUNb-REzQZZflwxA Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 31e42dd8f6ff445cb7d44b0b0ce94fc2 Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-VolumesActionsTest-920156870 Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:05:55.640407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:05:55.642668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/31e42dd8f6ff445cb7d44b0b0ce94fc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/31e42dd8f6ff445cb7d44b0b0ce94fc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_31e42dd8f6ff445cb7d44b0b0ce94fc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/31e42dd8f6ff445cb7d44b0b0ce94fc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:05:55.642668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-VolumesActionsTest-920156870 Sep 26 18:05:55.642668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 31e42dd8f6ff445cb7d44b0b0ce94fc2 Sep 26 18:05:55.642668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-VolumesActionsTest-920156870 Sep 26 18:05:55.642668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-VolumesActionsTest-920156870-project Sep 26 18:05:55.642668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:05:55.642668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:05:55.642668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 349bc0a30f324816804e596c937e3da0 Sep 26 18:05:55.642668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-VolumesActionsTest-920156870-project Sep 26 18:05:55.642668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:05:55.642668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance c3f7652f-6765-4967-9ff6-f112a4b367e9 could not be found. Sep 26 18:05:55.642668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': 'c3f7652f-6765-4967-9ff6-f112a4b367e9'} Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3f7652f-6765-4967-9ff6-f112a4b367e9 could not be found. Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:05:55.643494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3f7652f-6765-4967-9ff6-f112a4b367e9 could not be found. Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3f7652f-6765-4967-9ff6-f112a4b367e9 could not be found. Sep 26 18:05:55.644967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:05:55.646220 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-626c7082-5896-47c0-a952-cbadc4ecb6cf tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Returning 404 to user: Instance c3f7652f-6765-4967-9ff6-f112a4b367e9 could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:05:55.646220 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-626c7082-5896-47c0-a952-cbadc4ecb6cf tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9" status: 404 len: 111 microversion: 2.1 time: 0.033145 Sep 26 18:05:55.646220 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 163/318] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:55 2022] GET /compute/v2.1/servers/c3f7652f-6765-4967-9ff6-f112a4b367e9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:05:55.785860 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-364384792", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452", "networks": [{"uuid": "a142954b-43e8-41cf-b242-1c1db52c4d6c"}]}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:55.837020 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-fc70b92d-2aa9-4529-a776-e3bf89cb2a54 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:55.837020 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-fc70b92d-2aa9-4529-a776-e3bf89cb2a54 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:55.839560 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fc70b92d-2aa9-4529-a776-e3bf89cb2a54 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:55.840315 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fc70b92d-2aa9-4529-a776-e3bf89cb2a54 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:55.841176 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fc70b92d-2aa9-4529-a776-e3bf89cb2a54 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:55.842112 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fc70b92d-2aa9-4529-a776-e3bf89cb2a54 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:55.843640 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fc70b92d-2aa9-4529-a776-e3bf89cb2a54 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:55.844797 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fc70b92d-2aa9-4529-a776-e3bf89cb2a54 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:55.855776 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.network.neutron [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] validate_networks() for [('a142954b-43e8-41cf-b242-1c1db52c4d6c', None, None, None, None, None)] {{(pid=121029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:05:56.151312 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-fc70b92d-2aa9-4529-a776-e3bf89cb2a54 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:56.165399 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-fc70b92d-2aa9-4529-a776-e3bf89cb2a54 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1514 microversion: 2.1 time: 0.338489 Sep 26 18:05:56.166728 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 164/319] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:55 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1514 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:56.170861 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a562f69c-58fd-46d1-85bf-f915ca1b17a8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:56.171679 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a562f69c-58fd-46d1-85bf-f915ca1b17a8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:56.208117 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a562f69c-58fd-46d1-85bf-f915ca1b17a8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:56.208117 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a562f69c-58fd-46d1-85bf-f915ca1b17a8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:56.208117 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a562f69c-58fd-46d1-85bf-f915ca1b17a8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:56.208117 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a562f69c-58fd-46d1-85bf-f915ca1b17a8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:56.208718 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a562f69c-58fd-46d1-85bf-f915ca1b17a8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:56.208718 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a562f69c-58fd-46d1-85bf-f915ca1b17a8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:56.333420 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a562f69c-58fd-46d1-85bf-f915ca1b17a8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:56.353176 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a562f69c-58fd-46d1-85bf-f915ca1b17a8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1238 microversion: 2.1 time: 0.186342 Sep 26 18:05:56.353756 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 165/320] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:56 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1238 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:56.360612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-605a1f45-32ed-43d1-a396-c69a0eb62362 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:56.361470 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-605a1f45-32ed-43d1-a396-c69a0eb62362 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:56.374430 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-605a1f45-32ed-43d1-a396-c69a0eb62362 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:56.374430 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-605a1f45-32ed-43d1-a396-c69a0eb62362 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:56.374430 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-605a1f45-32ed-43d1-a396-c69a0eb62362 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:56.374430 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-605a1f45-32ed-43d1-a396-c69a0eb62362 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:56.374914 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-605a1f45-32ed-43d1-a396-c69a0eb62362 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:56.374914 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-605a1f45-32ed-43d1-a396-c69a0eb62362 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:56.985834 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-605a1f45-32ed-43d1-a396-c69a0eb62362 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:57.004870 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-605a1f45-32ed-43d1-a396-c69a0eb62362 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:57.007782 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-605a1f45-32ed-43d1-a396-c69a0eb62362 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:57.010037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-605a1f45-32ed-43d1-a396-c69a0eb62362 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1408 microversion: 2.20 time: 0.654516 Sep 26 18:05:57.011831 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 166/321] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:56 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1408 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:57.027683 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-341c10eb-d99e-4b84-b511-a96cedb36a7b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:57.029519 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-341c10eb-d99e-4b84-b511-a96cedb36a7b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:57.041410 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-341c10eb-d99e-4b84-b511-a96cedb36a7b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:57.042621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-341c10eb-d99e-4b84-b511-a96cedb36a7b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:57.043858 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-341c10eb-d99e-4b84-b511-a96cedb36a7b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:57.046324 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-341c10eb-d99e-4b84-b511-a96cedb36a7b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:57.047503 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-341c10eb-d99e-4b84-b511-a96cedb36a7b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:57.048244 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-341c10eb-d99e-4b84-b511-a96cedb36a7b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:57.067273 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Flavor limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:05:57.070397 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Image limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:05:57.072599 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Flavor pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:05:57.074065 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Image pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:05:57.076587 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:05:57.101797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:57.102546 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:57.103153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:57.104368 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:57.105277 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:57.105277 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:57.144045 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Getting quotas for project 31e42dd8f6ff445cb7d44b0b0ce94fc2. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:05:57.152173 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Getting quotas for user 349bc0a30f324816804e596c937e3da0 and project 31e42dd8f6ff445cb7d44b0b0ce94fc2. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:05:57.159509 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:57.183363 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Going to run 1 instances... {{(pid=121029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:05:57.189122 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:05:57.449785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-517d2c21-2f8b-4848-a2cd-c0b68533bab8 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.668784 Sep 26 18:05:57.461428 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 156/322] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:05:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:05:57.466804 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-4b3d1dbc-1826-4cfa-b797-6fbb1b4b7615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:57.476631 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-4b3d1dbc-1826-4cfa-b797-6fbb1b4b7615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:57.492282 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b3d1dbc-1826-4cfa-b797-6fbb1b4b7615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:57.494285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b3d1dbc-1826-4cfa-b797-6fbb1b4b7615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:57.495199 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b3d1dbc-1826-4cfa-b797-6fbb1b4b7615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:57.496318 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b3d1dbc-1826-4cfa-b797-6fbb1b4b7615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:57.496873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b3d1dbc-1826-4cfa-b797-6fbb1b4b7615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:57.497722 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b3d1dbc-1826-4cfa-b797-6fbb1b4b7615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:57.642852 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-4b3d1dbc-1826-4cfa-b797-6fbb1b4b7615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:57.656908 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-4b3d1dbc-1826-4cfa-b797-6fbb1b4b7615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1294 microversion: 2.1 time: 0.192789 Sep 26 18:05:57.659189 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 157/323] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:57 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1294 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:57.665124 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-341c10eb-d99e-4b84-b511-a96cedb36a7b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:57.685057 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-341c10eb-d99e-4b84-b511-a96cedb36a7b tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1470 microversion: 2.1 time: 0.667699 Sep 26 18:05:57.686245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 167/324] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:57 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1470 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:57.686728 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-3b98686f-2352-4fc6-a86c-2e1d3746e74e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:57.688850 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3b98686f-2352-4fc6-a86c-2e1d3746e74e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:57.778550 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3b98686f-2352-4fc6-a86c-2e1d3746e74e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:57.791919 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-3b98686f-2352-4fc6-a86c-2e1d3746e74e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1213 microversion: 2.1 time: 0.131199 Sep 26 18:05:57.798014 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 158/325] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:57 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1213 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:58.061029 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-df03a42e-cc81-4511-8c31-6915d54ed8b3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:58.062085 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-df03a42e-cc81-4511-8c31-6915d54ed8b3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:58.090519 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=4 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:58.107558 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-8564f912-4c5f-4755-9731-1e5be0db0200 req-6cffebb6-bf86-4e6e-8c05-76369ded48dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692e2930-4f2e-4999-be6a-e3824248177d", "name": "network-vif-deleted", "tag": "77f9ad03-b62f-4dda-ba71-0c74b66daab5"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:58.108339 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-df03a42e-cc81-4511-8c31-6915d54ed8b3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:58.109267 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-df03a42e-cc81-4511-8c31-6915d54ed8b3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:58.110592 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-df03a42e-cc81-4511-8c31-6915d54ed8b3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:58.119625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-df03a42e-cc81-4511-8c31-6915d54ed8b3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:58.120448 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-df03a42e-cc81-4511-8c31-6915d54ed8b3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:58.121449 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-df03a42e-cc81-4511-8c31-6915d54ed8b3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:58.151639 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-8564f912-4c5f-4755-9731-1e5be0db0200 req-6cffebb6-bf86-4e6e-8c05-76369ded48dc service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:58.153849 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-8564f912-4c5f-4755-9731-1e5be0db0200 req-6cffebb6-bf86-4e6e-8c05-76369ded48dc service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:58.156287 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-8564f912-4c5f-4755-9731-1e5be0db0200 req-6cffebb6-bf86-4e6e-8c05-76369ded48dc service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:58.196468 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-8564f912-4c5f-4755-9731-1e5be0db0200 req-6cffebb6-bf86-4e6e-8c05-76369ded48dc service nova] Creating event network-vif-deleted:77f9ad03-b62f-4dda-ba71-0c74b66daab5 for instance 692e2930-4f2e-4999-be6a-e3824248177d on hv-cinder-85931 Sep 26 18:05:58.209019 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-8564f912-4c5f-4755-9731-1e5be0db0200 req-6cffebb6-bf86-4e6e-8c05-76369ded48dc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106299 Sep 26 18:05:58.210175 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 159/326] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:05:58.381559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-fabae49f-ea57-48ed-907e-71c18a675d98 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Action: 'create', calling method: .version_select at 0x7f3a74ae6790>, body: {"keypair": {"name": "tempest-keypair-741279528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODHGnBI2R6XWVvPlyUeQYpGJ6qFmXDZQVuxUbpgokHEYqSZvSt6LbuYIRAtFY0Jsmi9Mvjp3vSVQx4ux11ncul4JF3DJQ3+DydOizHHpL6hxtjlZvW34SpqoDyT/48SNg=="}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:05:58.462356 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-fabae49f-ea57-48ed-907e-71c18a675d98 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Getting quotas for project 3a15ebd862054a64ac1d739db5adc3a2. Resources: {'key_pairs'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:05:58.492284 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-fabae49f-ea57-48ed-907e-71c18a675d98 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Getting quotas for user 97ed136f68c540abbdaf04cbe34a682e and project 3a15ebd862054a64ac1d739db5adc3a2. Resources: {'key_pairs'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:05:58.662037 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-fabae49f-ea57-48ed-907e-71c18a675d98 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.290133 Sep 26 18:05:58.662734 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 160/327] 10.222.0.67 () {60 vars in 1159 bytes} [Mon Sep 26 18:05:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:05:58.669864 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=20 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:58.715405 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-35893ee2-d846-45f1-b99c-e7a530578d1b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:58.716789 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-35893ee2-d846-45f1-b99c-e7a530578d1b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:58.729265 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-35893ee2-d846-45f1-b99c-e7a530578d1b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:58.730154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-35893ee2-d846-45f1-b99c-e7a530578d1b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:58.730925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-35893ee2-d846-45f1-b99c-e7a530578d1b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:58.733131 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-35893ee2-d846-45f1-b99c-e7a530578d1b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:58.733131 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-35893ee2-d846-45f1-b99c-e7a530578d1b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:58.733658 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-35893ee2-d846-45f1-b99c-e7a530578d1b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:58.902339 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-35893ee2-d846-45f1-b99c-e7a530578d1b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:58.913802 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-35893ee2-d846-45f1-b99c-e7a530578d1b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1300 microversion: 2.1 time: 0.205822 Sep 26 18:05:58.914505 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 161/328] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:58 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1300 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:58.946498 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-17f28a1a-ba33-4d4c-996d-6ed7d26d8536 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:58.949972 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-17f28a1a-ba33-4d4c-996d-6ed7d26d8536 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:58.973218 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-17f28a1a-ba33-4d4c-996d-6ed7d26d8536 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:58.974122 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-17f28a1a-ba33-4d4c-996d-6ed7d26d8536 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:58.980986 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-17f28a1a-ba33-4d4c-996d-6ed7d26d8536 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:58.987904 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-17f28a1a-ba33-4d4c-996d-6ed7d26d8536 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:58.987904 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-17f28a1a-ba33-4d4c-996d-6ed7d26d8536 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:58.987904 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-17f28a1a-ba33-4d4c-996d-6ed7d26d8536 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:58.988253 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-df03a42e-cc81-4511-8c31-6915d54ed8b3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:59.005321 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-df03a42e-cc81-4511-8c31-6915d54ed8b3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:59.007116 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-df03a42e-cc81-4511-8c31-6915d54ed8b3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:59.008554 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-df03a42e-cc81-4511-8c31-6915d54ed8b3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1408 microversion: 2.20 time: 0.957431 Sep 26 18:05:59.009537 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 168/329] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:05:58 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1408 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:05:59.026943 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ad172b4f-5b78-4e7d-8d09-e2f7f0703a04 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:59.028433 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ad172b4f-5b78-4e7d-8d09-e2f7f0703a04 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:05:59.066984 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-17f28a1a-ba33-4d4c-996d-6ed7d26d8536 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:05:59.066984 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-17f28a1a-ba33-4d4c-996d-6ed7d26d8536 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:05:59.066984 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-17f28a1a-ba33-4d4c-996d-6ed7d26d8536 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:05:59.066984 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-17f28a1a-ba33-4d4c-996d-6ed7d26d8536 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lazy-loading 'fault' on Instance uuid 692e2930-4f2e-4999-be6a-e3824248177d {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:05:59.170503 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ad172b4f-5b78-4e7d-8d09-e2f7f0703a04 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:59.191232 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ad172b4f-5b78-4e7d-8d09-e2f7f0703a04 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1213 microversion: 2.1 time: 0.178850 Sep 26 18:05:59.193948 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 169/330] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:59 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1213 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:59.198470 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-17f28a1a-ba33-4d4c-996d-6ed7d26d8536 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046e50a17a6a4783895782d3aa2172e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee85100e2744253bece8a0d74c79f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:05:59.224829 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-17f28a1a-ba33-4d4c-996d-6ed7d26d8536 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 200 len: 1304 microversion: 2.1 time: 0.283446 Sep 26 18:05:59.226383 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 162/331] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:58 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 1304 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:05:59.966900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3434c9e5-cd88-4dad-b55d-f793ff2d6a60 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:05:59.968062 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-3434c9e5-cd88-4dad-b55d-f793ff2d6a60 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:00.053274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-258f4845-0f30-457c-80f5-16fe05db7192 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:00.054149 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-258f4845-0f30-457c-80f5-16fe05db7192 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:00.059243 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3434c9e5-cd88-4dad-b55d-f793ff2d6a60 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:00.060461 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3434c9e5-cd88-4dad-b55d-f793ff2d6a60 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:00.067305 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3434c9e5-cd88-4dad-b55d-f793ff2d6a60 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:00.069853 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3434c9e5-cd88-4dad-b55d-f793ff2d6a60 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:00.070692 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3434c9e5-cd88-4dad-b55d-f793ff2d6a60 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:00.071448 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3434c9e5-cd88-4dad-b55d-f793ff2d6a60 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:00.108591 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-258f4845-0f30-457c-80f5-16fe05db7192 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:00.116971 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-258f4845-0f30-457c-80f5-16fe05db7192 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:00.117447 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-258f4845-0f30-457c-80f5-16fe05db7192 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:00.127623 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-258f4845-0f30-457c-80f5-16fe05db7192 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:00.128843 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-258f4845-0f30-457c-80f5-16fe05db7192 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:00.130558 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-258f4845-0f30-457c-80f5-16fe05db7192 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:00.398106 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3434c9e5-cd88-4dad-b55d-f793ff2d6a60 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:00.409941 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-3434c9e5-cd88-4dad-b55d-f793ff2d6a60 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1300 microversion: 2.1 time: 0.453802 Sep 26 18:06:00.423743 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 170/332] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:05:59 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1300 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:00.423743 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-07d909ab-dbe6-46ab-bad8-3a8a3a7df845 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:00.423743 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-07d909ab-dbe6-46ab-bad8-3a8a3a7df845 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:00.429979 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-07d909ab-dbe6-46ab-bad8-3a8a3a7df845 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:00.431166 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-07d909ab-dbe6-46ab-bad8-3a8a3a7df845 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:00.436035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-07d909ab-dbe6-46ab-bad8-3a8a3a7df845 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:00.436035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-07d909ab-dbe6-46ab-bad8-3a8a3a7df845 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:00.436035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-07d909ab-dbe6-46ab-bad8-3a8a3a7df845 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:00.436035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-07d909ab-dbe6-46ab-bad8-3a8a3a7df845 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:00.551759 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-07d909ab-dbe6-46ab-bad8-3a8a3a7df845 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:00.567790 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-07d909ab-dbe6-46ab-bad8-3a8a3a7df845 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1209 microversion: 2.1 time: 0.155395 Sep 26 18:06:00.569073 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 171/333] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:00 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1209 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:00.577852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c554a851-ac0c-4628-8203-4a2c3f5c0974 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:00.579887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c554a851-ac0c-4628-8203-4a2c3f5c0974 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] [instance: 692e2930-4f2e-4999-be6a-e3824248177d] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:00.587863 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c554a851-ac0c-4628-8203-4a2c3f5c0974 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:00.588583 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c554a851-ac0c-4628-8203-4a2c3f5c0974 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:00.589408 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c554a851-ac0c-4628-8203-4a2c3f5c0974 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:00.590517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c554a851-ac0c-4628-8203-4a2c3f5c0974 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:00.591484 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c554a851-ac0c-4628-8203-4a2c3f5c0974 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:00.592548 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c554a851-ac0c-4628-8203-4a2c3f5c0974 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:00.616409 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-c554a851-ac0c-4628-8203-4a2c3f5c0974 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] HTTP exception thrown: Instance 692e2930-4f2e-4999-be6a-e3824248177d could not be found. Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c554a851-ac0c-4628-8203-4a2c3f5c0974 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Request method failure captured: Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d HTTP/1.1 Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMenb-F99PTBz6Nek_f7oErCgQm5Y0aFLbUVUeviiDA5sbUvTl2E_OH7Y9TJ4yainTeexs3Rz8ZdWEYn6QJRQQrfRnCblq0whFsXSOotXzNtVLkbXhzHakzbwjLgXMliUu3DhxtYgNlPxkakQD29_0eA225A-jyFt6j8ITERzSuESaos Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: dee85100e2744253bece8a0d74c79f41 Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-VolumesNegativeTest-2099923738 Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:06:00.618316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:06:00.622711 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dee85100e2744253bece8a0d74c79f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dee85100e2744253bece8a0d74c79f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dee85100e2744253bece8a0d74c79f41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dee85100e2744253bece8a0d74c79f41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:06:00.622711 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-VolumesNegativeTest-2099923738 Sep 26 18:06:00.622711 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: dee85100e2744253bece8a0d74c79f41 Sep 26 18:06:00.622711 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-VolumesNegativeTest-2099923738 Sep 26 18:06:00.622711 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-VolumesNegativeTest-2099923738-project Sep 26 18:06:00.622711 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:06:00.622711 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:06:00.622711 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 046e50a17a6a4783895782d3aa2172e2 Sep 26 18:06:00.622711 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-VolumesNegativeTest-2099923738-project Sep 26 18:06:00.622711 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:06:00.622711 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance 692e2930-4f2e-4999-be6a-e3824248177d could not be found. Sep 26 18:06:00.622711 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '692e2930-4f2e-4999-be6a-e3824248177d'} Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 692e2930-4f2e-4999-be6a-e3824248177d could not be found. Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:00.623997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 692e2930-4f2e-4999-be6a-e3824248177d could not be found. Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 692e2930-4f2e-4999-be6a-e3824248177d could not be found. Sep 26 18:06:00.626774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:06:00.628659 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c554a851-ac0c-4628-8203-4a2c3f5c0974 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] Returning 404 to user: Instance 692e2930-4f2e-4999-be6a-e3824248177d could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:00.628659 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c554a851-ac0c-4628-8203-4a2c3f5c0974 tempest-VolumesNegativeTest-2099923738 tempest-VolumesNegativeTest-2099923738-project] 10.222.0.67 "GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d" status: 404 len: 111 microversion: 2.1 time: 0.050821 Sep 26 18:06:00.628659 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 172/334] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:00 2022] GET /compute/v2.1/servers/692e2930-4f2e-4999-be6a-e3824248177d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:06:00.648488 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-453534e1-348e-4afc-bffa-5285b59bfef1 req-7256f39b-bb4f-4cc6-9f8f-44995c7651a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6298d28-8cba-46d8-a809-bd0f81e18d58", "tag": "a14f5b04-fe69-47de-b23e-8ff9f06a4aae"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:00.669290 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-453534e1-348e-4afc-bffa-5285b59bfef1 req-7256f39b-bb4f-4cc6-9f8f-44995c7651a6 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:00.669969 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-453534e1-348e-4afc-bffa-5285b59bfef1 req-7256f39b-bb4f-4cc6-9f8f-44995c7651a6 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:00.670496 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-453534e1-348e-4afc-bffa-5285b59bfef1 req-7256f39b-bb4f-4cc6-9f8f-44995c7651a6 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:00.688001 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=100 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:00.690270 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-453534e1-348e-4afc-bffa-5285b59bfef1 req-7256f39b-bb4f-4cc6-9f8f-44995c7651a6 service nova] Creating event network-changed:a14f5b04-fe69-47de-b23e-8ff9f06a4aae for instance f6298d28-8cba-46d8-a809-bd0f81e18d58 on hv-cinder-85931 Sep 26 18:06:00.697721 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-453534e1-348e-4afc-bffa-5285b59bfef1 req-7256f39b-bb4f-4cc6-9f8f-44995c7651a6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064404 Sep 26 18:06:00.698538 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 173/335] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:00.733800 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-258f4845-0f30-457c-80f5-16fe05db7192 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:00.768041 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-258f4845-0f30-457c-80f5-16fe05db7192 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:00.773317 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-258f4845-0f30-457c-80f5-16fe05db7192 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:00.774940 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-258f4845-0f30-457c-80f5-16fe05db7192 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1408 microversion: 2.20 time: 0.733306 Sep 26 18:06:00.776744 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 163/336] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:06:00 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1408 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:06:01.452181 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-7923f5a7-ef13-4b26-8843-4aa4c0b27677 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:01.456473 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-7923f5a7-ef13-4b26-8843-4aa4c0b27677 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:01.472737 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7923f5a7-ef13-4b26-8843-4aa4c0b27677 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:01.473607 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7923f5a7-ef13-4b26-8843-4aa4c0b27677 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:01.488926 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7923f5a7-ef13-4b26-8843-4aa4c0b27677 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:01.493318 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7923f5a7-ef13-4b26-8843-4aa4c0b27677 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:01.493318 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7923f5a7-ef13-4b26-8843-4aa4c0b27677 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:01.493318 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7923f5a7-ef13-4b26-8843-4aa4c0b27677 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:01.612684 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-3eaa6732-4b08-4dac-a8cf-86c125737fce tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:01.613934 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3eaa6732-4b08-4dac-a8cf-86c125737fce tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:01.630868 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3eaa6732-4b08-4dac-a8cf-86c125737fce tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:01.631376 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3eaa6732-4b08-4dac-a8cf-86c125737fce tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:01.633292 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3eaa6732-4b08-4dac-a8cf-86c125737fce tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:01.633292 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3eaa6732-4b08-4dac-a8cf-86c125737fce tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:01.633292 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3eaa6732-4b08-4dac-a8cf-86c125737fce tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:01.633733 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3eaa6732-4b08-4dac-a8cf-86c125737fce tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:01.731901 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3eaa6732-4b08-4dac-a8cf-86c125737fce tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:01.752271 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-3eaa6732-4b08-4dac-a8cf-86c125737fce tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1265 microversion: 2.1 time: 0.153056 Sep 26 18:06:01.754708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 164/337] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:01 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:06:01.768890 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-7923f5a7-ef13-4b26-8843-4aa4c0b27677 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:01.782917 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-7923f5a7-ef13-4b26-8843-4aa4c0b27677 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1367 microversion: 2.1 time: 0.346032 Sep 26 18:06:01.802903 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 174/338] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:01 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:01.824153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-205d4a9e-9948-4095-9837-d60f10590cd5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:01.824153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-205d4a9e-9948-4095-9837-d60f10590cd5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:01.824153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-205d4a9e-9948-4095-9837-d60f10590cd5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:01.824153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-205d4a9e-9948-4095-9837-d60f10590cd5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:01.825133 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-205d4a9e-9948-4095-9837-d60f10590cd5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:01.825133 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-205d4a9e-9948-4095-9837-d60f10590cd5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:01.825133 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-205d4a9e-9948-4095-9837-d60f10590cd5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:01.825133 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-205d4a9e-9948-4095-9837-d60f10590cd5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:02.408908 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-205d4a9e-9948-4095-9837-d60f10590cd5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:02.423264 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-205d4a9e-9948-4095-9837-d60f10590cd5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:02.428867 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-205d4a9e-9948-4095-9837-d60f10590cd5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:02.428867 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-205d4a9e-9948-4095-9837-d60f10590cd5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1408 microversion: 2.20 time: 0.622669 Sep 26 18:06:02.428867 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 165/339] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:06:01 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1408 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:06:02.824045 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-89350170-4e22-4d57-9ccf-e8d0d87682f5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:02.824045 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-89350170-4e22-4d57-9ccf-e8d0d87682f5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:02.825082 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e020e59e-81ad-4b71-81bd-ed5deab14f7b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:02.825082 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e020e59e-81ad-4b71-81bd-ed5deab14f7b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:02.896218 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-89350170-4e22-4d57-9ccf-e8d0d87682f5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:02.897042 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-89350170-4e22-4d57-9ccf-e8d0d87682f5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:02.897674 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-89350170-4e22-4d57-9ccf-e8d0d87682f5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:02.901817 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-89350170-4e22-4d57-9ccf-e8d0d87682f5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:02.902581 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-89350170-4e22-4d57-9ccf-e8d0d87682f5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:02.903185 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-89350170-4e22-4d57-9ccf-e8d0d87682f5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:02.907703 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e020e59e-81ad-4b71-81bd-ed5deab14f7b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:02.911970 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e020e59e-81ad-4b71-81bd-ed5deab14f7b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:02.913080 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e020e59e-81ad-4b71-81bd-ed5deab14f7b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:02.914071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e020e59e-81ad-4b71-81bd-ed5deab14f7b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:02.915348 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e020e59e-81ad-4b71-81bd-ed5deab14f7b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:02.916127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e020e59e-81ad-4b71-81bd-ed5deab14f7b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:02.917523 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=100 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:03.184303 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e020e59e-81ad-4b71-81bd-ed5deab14f7b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:03.199667 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e020e59e-81ad-4b71-81bd-ed5deab14f7b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1265 microversion: 2.1 time: 0.397883 Sep 26 18:06:03.201255 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 175/340] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:02 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1265 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:03.226990 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1717114308", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45aee833-caf9-4514-8a4b-002783e94737"}], "security_groups": [{"name": "tempest-securitygroup--1635680067"}], "key_name": "tempest-keypair-741279528", "user_data": "}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:03.580274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-89350170-4e22-4d57-9ccf-e8d0d87682f5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:03.586273 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.network.neutron [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] validate_networks() for [('45aee833-caf9-4514-8a4b-002783e94737', None, None, None, None, None)] {{(pid=121028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:06:03.596859 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-89350170-4e22-4d57-9ccf-e8d0d87682f5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1367 microversion: 2.1 time: 0.786337 Sep 26 18:06:03.598003 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 166/341] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:02 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1367 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:06:03.607104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f417a8fc-80d0-497b-8b2a-7a5e68fcc3dd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:03.608585 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f417a8fc-80d0-497b-8b2a-7a5e68fcc3dd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:03.644578 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f417a8fc-80d0-497b-8b2a-7a5e68fcc3dd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:03.644578 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f417a8fc-80d0-497b-8b2a-7a5e68fcc3dd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:03.644578 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f417a8fc-80d0-497b-8b2a-7a5e68fcc3dd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:03.644578 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f417a8fc-80d0-497b-8b2a-7a5e68fcc3dd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:03.645163 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f417a8fc-80d0-497b-8b2a-7a5e68fcc3dd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:03.645163 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f417a8fc-80d0-497b-8b2a-7a5e68fcc3dd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:04.548781 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f417a8fc-80d0-497b-8b2a-7a5e68fcc3dd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:04.559993 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f417a8fc-80d0-497b-8b2a-7a5e68fcc3dd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:04.561690 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f417a8fc-80d0-497b-8b2a-7a5e68fcc3dd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:04.564773 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f417a8fc-80d0-497b-8b2a-7a5e68fcc3dd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1408 microversion: 2.20 time: 0.964808 Sep 26 18:06:04.575679 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 167/342] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:06:03 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1408 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:06:04.575679 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-2986f579-ca31-4521-9b0f-f78348cc4d2f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:04.575679 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-2986f579-ca31-4521-9b0f-f78348cc4d2f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:04.583249 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2986f579-ca31-4521-9b0f-f78348cc4d2f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:04.584901 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2986f579-ca31-4521-9b0f-f78348cc4d2f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:04.585902 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2986f579-ca31-4521-9b0f-f78348cc4d2f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:04.587225 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2986f579-ca31-4521-9b0f-f78348cc4d2f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:04.588840 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2986f579-ca31-4521-9b0f-f78348cc4d2f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:04.590586 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2986f579-ca31-4521-9b0f-f78348cc4d2f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:04.790856 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-2986f579-ca31-4521-9b0f-f78348cc4d2f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:04.803206 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-2986f579-ca31-4521-9b0f-f78348cc4d2f tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1271 microversion: 2.1 time: 0.236135 Sep 26 18:06:04.805030 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 168/343] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:04 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1271 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:04.814736 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-2c5853be-e79c-4282-a7e1-f007547e5c3c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:04.815884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-2c5853be-e79c-4282-a7e1-f007547e5c3c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:04.825117 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2c5853be-e79c-4282-a7e1-f007547e5c3c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:04.826827 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2c5853be-e79c-4282-a7e1-f007547e5c3c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:04.828934 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2c5853be-e79c-4282-a7e1-f007547e5c3c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:04.830217 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2c5853be-e79c-4282-a7e1-f007547e5c3c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:04.831511 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2c5853be-e79c-4282-a7e1-f007547e5c3c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:04.832451 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2c5853be-e79c-4282-a7e1-f007547e5c3c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:05.318817 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-2c5853be-e79c-4282-a7e1-f007547e5c3c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:05.327161 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-2c5853be-e79c-4282-a7e1-f007547e5c3c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1367 microversion: 2.1 time: 0.519833 Sep 26 18:06:05.328658 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 169/344] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:04 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1367 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:05.352530 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Flavor limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:06:05.353504 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Image limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:06:05.354125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Flavor pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:06:05.355019 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Image pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:06:05.355567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:06:05.394721 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:05.394721 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:05.397012 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:05.401806 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:05.405934 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:05.407444 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:05.446312 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Getting quotas for project 3a15ebd862054a64ac1d739db5adc3a2. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:06:05.454794 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Getting quotas for user 97ed136f68c540abbdaf04cbe34a682e and project 3a15ebd862054a64ac1d739db5adc3a2. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:06:05.459085 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-e4ee3a12-5d25-4ee6-b874-544237d99666 req-0afd9043-58d1-4ec5-ac43-2b5a57f97e40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a3d0414-434f-4d77-8bc1-57378672d4f8", "tag": "4db13c14-6478-4992-8d31-4a46754d492e"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:05.471042 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Going to run 1 instances... {{(pid=121028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:06:05.474198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:06:05.485118 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-e4ee3a12-5d25-4ee6-b874-544237d99666 req-0afd9043-58d1-4ec5-ac43-2b5a57f97e40 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:05.485759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-e4ee3a12-5d25-4ee6-b874-544237d99666 req-0afd9043-58d1-4ec5-ac43-2b5a57f97e40 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:05.492345 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-e4ee3a12-5d25-4ee6-b874-544237d99666 req-0afd9043-58d1-4ec5-ac43-2b5a57f97e40 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:05.515027 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-e4ee3a12-5d25-4ee6-b874-544237d99666 req-0afd9043-58d1-4ec5-ac43-2b5a57f97e40 service nova] Creating event network-changed:4db13c14-6478-4992-8d31-4a46754d492e for instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 on hv-cinder-85931 Sep 26 18:06:05.531934 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-e4ee3a12-5d25-4ee6-b874-544237d99666 req-0afd9043-58d1-4ec5-ac43-2b5a57f97e40 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075458 Sep 26 18:06:05.536388 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 170/345] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:05.601447 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-6accfd98-36c1-4e89-9ea4-06bfb7cd083d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:05.602223 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-6accfd98-36c1-4e89-9ea4-06bfb7cd083d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:05.608445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6accfd98-36c1-4e89-9ea4-06bfb7cd083d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:05.609181 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6accfd98-36c1-4e89-9ea4-06bfb7cd083d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:05.609815 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6accfd98-36c1-4e89-9ea4-06bfb7cd083d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:05.610918 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6accfd98-36c1-4e89-9ea4-06bfb7cd083d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:05.611384 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6accfd98-36c1-4e89-9ea4-06bfb7cd083d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:05.611843 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6accfd98-36c1-4e89-9ea4-06bfb7cd083d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:05.789407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ff2b8095-f2d8-4158-adab-bc3702bd3e69 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.573383 Sep 26 18:06:05.790302 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 176/346] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:06:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 2575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:06:05.813647 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9ba31e10-3ecf-4fe9-80cd-bfb54f368e75 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:05.822742 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9ba31e10-3ecf-4fe9-80cd-bfb54f368e75 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:05.987254 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9ba31e10-3ecf-4fe9-80cd-bfb54f368e75 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:06.005665 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-6accfd98-36c1-4e89-9ea4-06bfb7cd083d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:06.006589 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9ba31e10-3ecf-4fe9-80cd-bfb54f368e75 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1245 microversion: 2.1 time: 0.200632 Sep 26 18:06:06.010342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 177/347] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:05 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1245 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:06:06.024677 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-6accfd98-36c1-4e89-9ea4-06bfb7cd083d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:06.024677 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-6accfd98-36c1-4e89-9ea4-06bfb7cd083d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:06.024677 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-6accfd98-36c1-4e89-9ea4-06bfb7cd083d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1408 microversion: 2.20 time: 0.424680 Sep 26 18:06:06.030380 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 171/348] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:06:05 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1408 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:06:06.034936 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8a09cef3-1057-4136-82a0-084d4d85e567 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:06.036006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-8a09cef3-1057-4136-82a0-084d4d85e567 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:06.042984 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8a09cef3-1057-4136-82a0-084d4d85e567 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:06.043478 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8a09cef3-1057-4136-82a0-084d4d85e567 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:06.043932 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8a09cef3-1057-4136-82a0-084d4d85e567 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:06.044632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8a09cef3-1057-4136-82a0-084d4d85e567 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:06.045084 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8a09cef3-1057-4136-82a0-084d4d85e567 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:06.045817 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8a09cef3-1057-4136-82a0-084d4d85e567 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:06.356785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e1caef26-2af4-4f18-8c86-7e4a8e5d1a66 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:06.358231 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e1caef26-2af4-4f18-8c86-7e4a8e5d1a66 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:06.378807 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e1caef26-2af4-4f18-8c86-7e4a8e5d1a66 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:06.385173 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e1caef26-2af4-4f18-8c86-7e4a8e5d1a66 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:06.386262 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e1caef26-2af4-4f18-8c86-7e4a8e5d1a66 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:06.389172 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e1caef26-2af4-4f18-8c86-7e4a8e5d1a66 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:06.389172 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e1caef26-2af4-4f18-8c86-7e4a8e5d1a66 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:06.393271 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e1caef26-2af4-4f18-8c86-7e4a8e5d1a66 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:06.716073 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8a09cef3-1057-4136-82a0-084d4d85e567 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:06.726611 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8a09cef3-1057-4136-82a0-084d4d85e567 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1313 microversion: 2.1 time: 0.699673 Sep 26 18:06:06.727952 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 178/349] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:06 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1313 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:06.741263 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-39aeda2f-2fa6-4d01-8607-18c599c06d0c req-2aaa72bb-4811-4c68-9645-0b6df9da7fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6298d28-8cba-46d8-a809-bd0f81e18d58", "name": "network-vif-plugged", "status": "completed", "tag": "a14f5b04-fe69-47de-b23e-8ff9f06a4aae"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:06.756180 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-39aeda2f-2fa6-4d01-8607-18c599c06d0c req-2aaa72bb-4811-4c68-9645-0b6df9da7fa5 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:06.756799 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-39aeda2f-2fa6-4d01-8607-18c599c06d0c req-2aaa72bb-4811-4c68-9645-0b6df9da7fa5 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:06.757451 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-39aeda2f-2fa6-4d01-8607-18c599c06d0c req-2aaa72bb-4811-4c68-9645-0b6df9da7fa5 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:06.771372 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-39aeda2f-2fa6-4d01-8607-18c599c06d0c req-2aaa72bb-4811-4c68-9645-0b6df9da7fa5 service nova] Creating event network-vif-plugged:a14f5b04-fe69-47de-b23e-8ff9f06a4aae for instance f6298d28-8cba-46d8-a809-bd0f81e18d58 on hv-cinder-85931 Sep 26 18:06:06.777237 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-39aeda2f-2fa6-4d01-8607-18c599c06d0c req-2aaa72bb-4811-4c68-9645-0b6df9da7fa5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047600 Sep 26 18:06:06.777847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 179/350] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:06.862521 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e1caef26-2af4-4f18-8c86-7e4a8e5d1a66 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:06.875908 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e1caef26-2af4-4f18-8c86-7e4a8e5d1a66 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1367 microversion: 2.1 time: 0.525119 Sep 26 18:06:06.888568 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 172/351] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:06 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1367 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:07.047608 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-effd4781-1c12-4d5d-af13-64399750d305 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:07.050391 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-10a39e1a-2946-4ed3-9685-b64a1061f215 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:07.051093 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-10a39e1a-2946-4ed3-9685-b64a1061f215 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:07.053177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-effd4781-1c12-4d5d-af13-64399750d305 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:07.066362 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-effd4781-1c12-4d5d-af13-64399750d305 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:07.066989 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-effd4781-1c12-4d5d-af13-64399750d305 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:07.067530 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-effd4781-1c12-4d5d-af13-64399750d305 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:07.068391 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-effd4781-1c12-4d5d-af13-64399750d305 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:07.069111 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-effd4781-1c12-4d5d-af13-64399750d305 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:07.076047 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-effd4781-1c12-4d5d-af13-64399750d305 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:07.123708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:07.206137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-10a39e1a-2946-4ed3-9685-b64a1061f215 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:07.224558 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-10a39e1a-2946-4ed3-9685-b64a1061f215 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1245 microversion: 2.1 time: 0.182703 Sep 26 18:06:07.227847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 180/352] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:07 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1245 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:07.450319 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-effd4781-1c12-4d5d-af13-64399750d305 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:07.464065 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-effd4781-1c12-4d5d-af13-64399750d305 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:07.464327 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-effd4781-1c12-4d5d-af13-64399750d305 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:07.466090 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-effd4781-1c12-4d5d-af13-64399750d305 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1408 microversion: 2.20 time: 0.424773 Sep 26 18:06:07.466814 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 173/353] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:06:07 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1408 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:06:07.769887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-7e46688b-3e39-457c-90f0-aa8c6f5c9754 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:07.772489 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-7e46688b-3e39-457c-90f0-aa8c6f5c9754 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:07.783267 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7e46688b-3e39-457c-90f0-aa8c6f5c9754 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:07.784513 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7e46688b-3e39-457c-90f0-aa8c6f5c9754 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:07.785238 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7e46688b-3e39-457c-90f0-aa8c6f5c9754 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:07.786790 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7e46688b-3e39-457c-90f0-aa8c6f5c9754 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:07.787925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7e46688b-3e39-457c-90f0-aa8c6f5c9754 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:07.788879 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7e46688b-3e39-457c-90f0-aa8c6f5c9754 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:07.915042 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-64bad024-785d-45a2-8301-13b54278ad32 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:07.916030 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-64bad024-785d-45a2-8301-13b54278ad32 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:07.926128 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64bad024-785d-45a2-8301-13b54278ad32 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:07.929412 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64bad024-785d-45a2-8301-13b54278ad32 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:07.929412 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64bad024-785d-45a2-8301-13b54278ad32 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:07.929412 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64bad024-785d-45a2-8301-13b54278ad32 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:07.929866 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64bad024-785d-45a2-8301-13b54278ad32 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:07.930710 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64bad024-785d-45a2-8301-13b54278ad32 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:08.200249 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-7e46688b-3e39-457c-90f0-aa8c6f5c9754 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:08.217105 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-7e46688b-3e39-457c-90f0-aa8c6f5c9754 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1313 microversion: 2.1 time: 0.454214 Sep 26 18:06:08.219268 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 181/354] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:07 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:08.253326 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-af0955ee-76ab-4a12-8200-0a7bdf37cadb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:08.253947 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-af0955ee-76ab-4a12-8200-0a7bdf37cadb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:08.262406 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af0955ee-76ab-4a12-8200-0a7bdf37cadb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:08.263925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af0955ee-76ab-4a12-8200-0a7bdf37cadb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:08.264388 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af0955ee-76ab-4a12-8200-0a7bdf37cadb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:08.265139 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af0955ee-76ab-4a12-8200-0a7bdf37cadb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:08.266197 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af0955ee-76ab-4a12-8200-0a7bdf37cadb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:08.266715 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af0955ee-76ab-4a12-8200-0a7bdf37cadb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:08.287508 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-64bad024-785d-45a2-8301-13b54278ad32 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:08.300203 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-64bad024-785d-45a2-8301-13b54278ad32 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1367 microversion: 2.1 time: 0.392153 Sep 26 18:06:08.301309 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 174/355] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:07 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:08.379632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-af0955ee-76ab-4a12-8200-0a7bdf37cadb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:08.389230 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-af0955ee-76ab-4a12-8200-0a7bdf37cadb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1249 microversion: 2.1 time: 0.140286 Sep 26 18:06:08.392229 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 182/356] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:08 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1249 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:06:08.496796 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-86ec0384-169e-46cc-aef9-d80c7ad10e5d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:08.498782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-86ec0384-169e-46cc-aef9-d80c7ad10e5d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:08.507513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-86ec0384-169e-46cc-aef9-d80c7ad10e5d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:08.508960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-86ec0384-169e-46cc-aef9-d80c7ad10e5d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:08.508960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-86ec0384-169e-46cc-aef9-d80c7ad10e5d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:08.509641 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-86ec0384-169e-46cc-aef9-d80c7ad10e5d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:08.510268 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-86ec0384-169e-46cc-aef9-d80c7ad10e5d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:08.510874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-86ec0384-169e-46cc-aef9-d80c7ad10e5d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:08.511434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=22 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:08.738829 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-86ec0384-169e-46cc-aef9-d80c7ad10e5d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:08.748410 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-86ec0384-169e-46cc-aef9-d80c7ad10e5d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:08.749952 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-86ec0384-169e-46cc-aef9-d80c7ad10e5d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:08.751093 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-86ec0384-169e-46cc-aef9-d80c7ad10e5d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1408 microversion: 2.20 time: 0.261049 Sep 26 18:06:08.751693 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 175/357] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:06:08 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:06:08.903083 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-c6868340-0665-4f94-836b-da07d782e145 req-9448c5ca-8542-4fad-b235-7f072c1cde38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec0f212d-7662-44b8-b8f8-2bdb09383d23", "tag": "c3bcaded-511d-43f7-b35e-4fa6e8c47ecf"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:08.921386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-c6868340-0665-4f94-836b-da07d782e145 req-9448c5ca-8542-4fad-b235-7f072c1cde38 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:08.922705 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-c6868340-0665-4f94-836b-da07d782e145 req-9448c5ca-8542-4fad-b235-7f072c1cde38 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:08.923464 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-c6868340-0665-4f94-836b-da07d782e145 req-9448c5ca-8542-4fad-b235-7f072c1cde38 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:08.938482 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-c6868340-0665-4f94-836b-da07d782e145 req-9448c5ca-8542-4fad-b235-7f072c1cde38 service nova] Creating event network-changed:c3bcaded-511d-43f7-b35e-4fa6e8c47ecf for instance ec0f212d-7662-44b8-b8f8-2bdb09383d23 on hv-cinder-85931 Sep 26 18:06:08.943876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-c6868340-0665-4f94-836b-da07d782e145 req-9448c5ca-8542-4fad-b235-7f072c1cde38 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051559 Sep 26 18:06:08.944525 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 183/358] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:09.248074 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b6da176f-83e0-4c02-8044-f26aca68e63e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:09.248697 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b6da176f-83e0-4c02-8044-f26aca68e63e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:09.256859 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b6da176f-83e0-4c02-8044-f26aca68e63e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:09.257570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b6da176f-83e0-4c02-8044-f26aca68e63e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:09.258192 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b6da176f-83e0-4c02-8044-f26aca68e63e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:09.258901 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b6da176f-83e0-4c02-8044-f26aca68e63e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:09.259823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b6da176f-83e0-4c02-8044-f26aca68e63e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:09.260251 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b6da176f-83e0-4c02-8044-f26aca68e63e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:09.339365 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d071d7e2-c708-4aa9-8cdf-7f91ddbfb573 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:09.339365 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d071d7e2-c708-4aa9-8cdf-7f91ddbfb573 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:09.339365 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:09.347384 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d071d7e2-c708-4aa9-8cdf-7f91ddbfb573 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:09.348034 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d071d7e2-c708-4aa9-8cdf-7f91ddbfb573 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:09.348685 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d071d7e2-c708-4aa9-8cdf-7f91ddbfb573 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:09.349637 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d071d7e2-c708-4aa9-8cdf-7f91ddbfb573 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:09.350165 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d071d7e2-c708-4aa9-8cdf-7f91ddbfb573 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:09.350744 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d071d7e2-c708-4aa9-8cdf-7f91ddbfb573 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:09.608123 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b6da176f-83e0-4c02-8044-f26aca68e63e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:09.625943 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b6da176f-83e0-4c02-8044-f26aca68e63e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1313 microversion: 2.1 time: 0.381867 Sep 26 18:06:09.626578 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 176/359] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:09 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:09.637742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-28331986-717c-4e85-a0cb-a65755d1ae5c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:09.638696 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-28331986-717c-4e85-a0cb-a65755d1ae5c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:09.656121 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28331986-717c-4e85-a0cb-a65755d1ae5c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:09.659850 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28331986-717c-4e85-a0cb-a65755d1ae5c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:09.660911 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28331986-717c-4e85-a0cb-a65755d1ae5c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:09.662520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28331986-717c-4e85-a0cb-a65755d1ae5c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:09.663386 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28331986-717c-4e85-a0cb-a65755d1ae5c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:09.664109 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28331986-717c-4e85-a0cb-a65755d1ae5c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:09.700841 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d071d7e2-c708-4aa9-8cdf-7f91ddbfb573 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:09.723166 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d071d7e2-c708-4aa9-8cdf-7f91ddbfb573 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1367 microversion: 2.1 time: 0.396328 Sep 26 18:06:09.743691 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 184/360] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:09 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1367 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:09.778070 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-28331986-717c-4e85-a0cb-a65755d1ae5c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:09.785894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f692833f-2e19-4dad-ba1c-d3c350747ca6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:09.786792 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f692833f-2e19-4dad-ba1c-d3c350747ca6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:09.787330 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-28331986-717c-4e85-a0cb-a65755d1ae5c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1241 microversion: 2.1 time: 0.158967 Sep 26 18:06:09.788574 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 177/361] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:09 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1241 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:09.800028 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f692833f-2e19-4dad-ba1c-d3c350747ca6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:09.800757 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f692833f-2e19-4dad-ba1c-d3c350747ca6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:09.801530 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f692833f-2e19-4dad-ba1c-d3c350747ca6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:09.802656 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f692833f-2e19-4dad-ba1c-d3c350747ca6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:09.803339 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f692833f-2e19-4dad-ba1c-d3c350747ca6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:09.804150 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f692833f-2e19-4dad-ba1c-d3c350747ca6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:10.004107 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f692833f-2e19-4dad-ba1c-d3c350747ca6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:10.013569 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f692833f-2e19-4dad-ba1c-d3c350747ca6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:10.015065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f692833f-2e19-4dad-ba1c-d3c350747ca6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:10.016777 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f692833f-2e19-4dad-ba1c-d3c350747ca6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1408 microversion: 2.20 time: 0.237557 Sep 26 18:06:10.017502 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 185/362] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:06:09 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:06:10.661992 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-683a9df7-b76e-4792-87e4-715f4973fefc tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:10.663343 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-683a9df7-b76e-4792-87e4-715f4973fefc tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:10.674542 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-683a9df7-b76e-4792-87e4-715f4973fefc tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:10.675604 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-683a9df7-b76e-4792-87e4-715f4973fefc tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:10.676747 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-683a9df7-b76e-4792-87e4-715f4973fefc tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:10.677981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-683a9df7-b76e-4792-87e4-715f4973fefc tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:10.678690 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-683a9df7-b76e-4792-87e4-715f4973fefc tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:10.679415 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-683a9df7-b76e-4792-87e4-715f4973fefc tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:10.762257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-98c48bf0-f559-4b76-bf7d-36c861eaf9c6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:10.763163 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-98c48bf0-f559-4b76-bf7d-36c861eaf9c6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:10.771570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-98c48bf0-f559-4b76-bf7d-36c861eaf9c6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:10.772171 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-98c48bf0-f559-4b76-bf7d-36c861eaf9c6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:10.772765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-98c48bf0-f559-4b76-bf7d-36c861eaf9c6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:10.773709 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-98c48bf0-f559-4b76-bf7d-36c861eaf9c6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:10.774147 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-98c48bf0-f559-4b76-bf7d-36c861eaf9c6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:10.774625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-98c48bf0-f559-4b76-bf7d-36c861eaf9c6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:11.158952 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-98c48bf0-f559-4b76-bf7d-36c861eaf9c6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:11.159627 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-683a9df7-b76e-4792-87e4-715f4973fefc tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:11.172984 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-98c48bf0-f559-4b76-bf7d-36c861eaf9c6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1367 microversion: 2.1 time: 0.414997 Sep 26 18:06:11.173675 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 186/363] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:10 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1367 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:11.176217 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-683a9df7-b76e-4792-87e4-715f4973fefc tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1313 microversion: 2.1 time: 0.519563 Sep 26 18:06:11.178969 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b6259788-d3e2-43a6-98fa-56fe31a527e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:11.179783 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 178/364] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:10 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:11.179922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b6259788-d3e2-43a6-98fa-56fe31a527e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:11.186295 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6259788-d3e2-43a6-98fa-56fe31a527e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:11.187181 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6259788-d3e2-43a6-98fa-56fe31a527e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:11.187905 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6259788-d3e2-43a6-98fa-56fe31a527e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:11.189650 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6259788-d3e2-43a6-98fa-56fe31a527e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:11.190287 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6259788-d3e2-43a6-98fa-56fe31a527e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:11.190777 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7c2fad2d-13c7-45a3-9d7e-e7e4e464f764 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:11.191082 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6259788-d3e2-43a6-98fa-56fe31a527e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:11.192105 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7c2fad2d-13c7-45a3-9d7e-e7e4e464f764 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:11.211912 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7c2fad2d-13c7-45a3-9d7e-e7e4e464f764 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:11.212662 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7c2fad2d-13c7-45a3-9d7e-e7e4e464f764 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:11.213344 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7c2fad2d-13c7-45a3-9d7e-e7e4e464f764 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:11.215546 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7c2fad2d-13c7-45a3-9d7e-e7e4e464f764 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:11.216603 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7c2fad2d-13c7-45a3-9d7e-e7e4e464f764 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:11.217272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7c2fad2d-13c7-45a3-9d7e-e7e4e464f764 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:11.308970 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b6259788-d3e2-43a6-98fa-56fe31a527e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:11.317794 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b6259788-d3e2-43a6-98fa-56fe31a527e4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1297 microversion: 2.1 time: 0.142866 Sep 26 18:06:11.318583 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 187/365] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:11 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1297 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:11.459106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7c2fad2d-13c7-45a3-9d7e-e7e4e464f764 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:11.473230 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7c2fad2d-13c7-45a3-9d7e-e7e4e464f764 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:11.475190 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7c2fad2d-13c7-45a3-9d7e-e7e4e464f764 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:11.476470 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7c2fad2d-13c7-45a3-9d7e-e7e4e464f764 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1408 microversion: 2.20 time: 0.295152 Sep 26 18:06:11.477030 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 179/366] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:06:11 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1408 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:06:12.206455 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f524d817-1199-4371-a1b8-e5f0e315acfa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:12.209252 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f524d817-1199-4371-a1b8-e5f0e315acfa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:12.223273 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d9d051a7-1357-496f-9953-1a524de41d5e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:12.225843 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d9d051a7-1357-496f-9953-1a524de41d5e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:12.241974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f524d817-1199-4371-a1b8-e5f0e315acfa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:12.248465 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d9d051a7-1357-496f-9953-1a524de41d5e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:12.248887 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d9d051a7-1357-496f-9953-1a524de41d5e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:12.249281 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f524d817-1199-4371-a1b8-e5f0e315acfa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:12.250224 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d9d051a7-1357-496f-9953-1a524de41d5e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:12.250575 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f524d817-1199-4371-a1b8-e5f0e315acfa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:12.252048 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d9d051a7-1357-496f-9953-1a524de41d5e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:12.253305 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d9d051a7-1357-496f-9953-1a524de41d5e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:12.253671 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f524d817-1199-4371-a1b8-e5f0e315acfa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:12.254374 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f524d817-1199-4371-a1b8-e5f0e315acfa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:12.254875 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d9d051a7-1357-496f-9953-1a524de41d5e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:12.255636 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f524d817-1199-4371-a1b8-e5f0e315acfa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:12.544195 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d9d051a7-1357-496f-9953-1a524de41d5e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:12.567607 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f524d817-1199-4371-a1b8-e5f0e315acfa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:12.578588 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d9d051a7-1357-496f-9953-1a524de41d5e tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1313 microversion: 2.1 time: 0.362273 Sep 26 18:06:12.581230 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f524d817-1199-4371-a1b8-e5f0e315acfa tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1367 microversion: 2.1 time: 0.383853 Sep 26 18:06:12.582590 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 188/367] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:12 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:12.597562 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 180/368] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:12 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:12.611449 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a310fa4d-7f20-4b95-ab91-8668f2198bca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:12.612876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a310fa4d-7f20-4b95-ab91-8668f2198bca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:12.613879 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-38d466ea-dc0d-41c4-b704-db3691af265e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:12.615298 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-38d466ea-dc0d-41c4-b704-db3691af265e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:12.622486 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a310fa4d-7f20-4b95-ab91-8668f2198bca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:12.622486 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a310fa4d-7f20-4b95-ab91-8668f2198bca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:12.622486 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a310fa4d-7f20-4b95-ab91-8668f2198bca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:12.622486 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a310fa4d-7f20-4b95-ab91-8668f2198bca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:12.623180 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a310fa4d-7f20-4b95-ab91-8668f2198bca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:12.623344 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a310fa4d-7f20-4b95-ab91-8668f2198bca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:12.631922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38d466ea-dc0d-41c4-b704-db3691af265e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:12.632576 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38d466ea-dc0d-41c4-b704-db3691af265e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:12.633076 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38d466ea-dc0d-41c4-b704-db3691af265e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:12.633848 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38d466ea-dc0d-41c4-b704-db3691af265e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:12.635098 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38d466ea-dc0d-41c4-b704-db3691af265e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:12.635538 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38d466ea-dc0d-41c4-b704-db3691af265e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:12.771916 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-38d466ea-dc0d-41c4-b704-db3691af265e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:12.778785 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-38d466ea-dc0d-41c4-b704-db3691af265e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1297 microversion: 2.1 time: 0.194798 Sep 26 18:06:12.780087 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 189/369] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:12 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1297 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:12.846019 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a310fa4d-7f20-4b95-ab91-8668f2198bca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:12.865122 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a310fa4d-7f20-4b95-ab91-8668f2198bca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:12.866531 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a310fa4d-7f20-4b95-ab91-8668f2198bca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:12.868050 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a310fa4d-7f20-4b95-ab91-8668f2198bca tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1599 microversion: 2.20 time: 0.268466 Sep 26 18:06:12.869293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 181/370] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:06:12 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1599 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:06:12.907183 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8b629501-0be9-475e-868b-64e9f0892e01 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:12.907894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-8b629501-0be9-475e-868b-64e9f0892e01 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:12.914630 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8b629501-0be9-475e-868b-64e9f0892e01 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:12.915124 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8b629501-0be9-475e-868b-64e9f0892e01 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:12.920059 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8b629501-0be9-475e-868b-64e9f0892e01 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:12.920059 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8b629501-0be9-475e-868b-64e9f0892e01 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:12.920059 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8b629501-0be9-475e-868b-64e9f0892e01 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:12.920059 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8b629501-0be9-475e-868b-64e9f0892e01 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:13.070286 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8b629501-0be9-475e-868b-64e9f0892e01 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.168018 Sep 26 18:06:13.075882 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 190/371] 10.222.0.67 () {60 vars in 1316 bytes} [Mon Sep 26 18:06:12 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 18:06:13.622112 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b4f8cd05-2f9b-47cb-b29d-96a4fa0fb074 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:13.623920 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-96e112aa-cbb9-46c6-a77e-cd70248284ba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:13.624662 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-96e112aa-cbb9-46c6-a77e-cd70248284ba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:13.626352 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b4f8cd05-2f9b-47cb-b29d-96a4fa0fb074 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:13.645259 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-96e112aa-cbb9-46c6-a77e-cd70248284ba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:13.647789 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-96e112aa-cbb9-46c6-a77e-cd70248284ba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:13.649976 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-96e112aa-cbb9-46c6-a77e-cd70248284ba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:13.655004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-96e112aa-cbb9-46c6-a77e-cd70248284ba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:13.655004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-96e112aa-cbb9-46c6-a77e-cd70248284ba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:13.656447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-96e112aa-cbb9-46c6-a77e-cd70248284ba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:13.668783 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b4f8cd05-2f9b-47cb-b29d-96a4fa0fb074 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:13.675310 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b4f8cd05-2f9b-47cb-b29d-96a4fa0fb074 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:13.675310 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b4f8cd05-2f9b-47cb-b29d-96a4fa0fb074 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:13.675310 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b4f8cd05-2f9b-47cb-b29d-96a4fa0fb074 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:13.675310 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b4f8cd05-2f9b-47cb-b29d-96a4fa0fb074 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:13.676362 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b4f8cd05-2f9b-47cb-b29d-96a4fa0fb074 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:14.220664 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b4f8cd05-2f9b-47cb-b29d-96a4fa0fb074 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:14.244929 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-96e112aa-cbb9-46c6-a77e-cd70248284ba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:14.256027 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b4f8cd05-2f9b-47cb-b29d-96a4fa0fb074 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1313 microversion: 2.1 time: 0.647711 Sep 26 18:06:14.256678 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-96e112aa-cbb9-46c6-a77e-cd70248284ba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1367 microversion: 2.1 time: 0.639681 Sep 26 18:06:14.257274 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 191/372] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:13 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1367 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:14.288423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-218cb87d-7e9d-4fda-b0c6-6ecd6854c2df tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:14.288754 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 182/373] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:13 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1313 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:14.289543 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-218cb87d-7e9d-4fda-b0c6-6ecd6854c2df tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:14.308410 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-218cb87d-7e9d-4fda-b0c6-6ecd6854c2df tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:14.309746 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-218cb87d-7e9d-4fda-b0c6-6ecd6854c2df tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:14.311811 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-218cb87d-7e9d-4fda-b0c6-6ecd6854c2df tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:14.314923 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-218cb87d-7e9d-4fda-b0c6-6ecd6854c2df tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:14.315600 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-218cb87d-7e9d-4fda-b0c6-6ecd6854c2df tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:14.316269 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-218cb87d-7e9d-4fda-b0c6-6ecd6854c2df tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:14.600277 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-218cb87d-7e9d-4fda-b0c6-6ecd6854c2df tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:14.634852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-218cb87d-7e9d-4fda-b0c6-6ecd6854c2df tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1305 microversion: 2.1 time: 0.355278 Sep 26 18:06:14.638968 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 192/374] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:14 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1305 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:14.716039 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-9005a732-dca1-4dac-853b-37e4329349b7 req-27757988-1ed8-4589-b0e6-bd629d62073c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a3d0414-434f-4d77-8bc1-57378672d4f8", "name": "network-vif-plugged", "status": "completed", "tag": "4db13c14-6478-4992-8d31-4a46754d492e"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:14.743204 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-9005a732-dca1-4dac-853b-37e4329349b7 req-27757988-1ed8-4589-b0e6-bd629d62073c service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:14.744027 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-9005a732-dca1-4dac-853b-37e4329349b7 req-27757988-1ed8-4589-b0e6-bd629d62073c service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:14.744628 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-9005a732-dca1-4dac-853b-37e4329349b7 req-27757988-1ed8-4589-b0e6-bd629d62073c service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:14.776827 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-9005a732-dca1-4dac-853b-37e4329349b7 req-27757988-1ed8-4589-b0e6-bd629d62073c service nova] Creating event network-vif-plugged:4db13c14-6478-4992-8d31-4a46754d492e for instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 on hv-cinder-85931 Sep 26 18:06:14.789817 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-9005a732-dca1-4dac-853b-37e4329349b7 req-27757988-1ed8-4589-b0e6-bd629d62073c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078081 Sep 26 18:06:14.794214 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 183/375] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:15.291227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-0720e682-af5f-45d2-b60b-a0bff243a35e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:15.292050 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-0720e682-af5f-45d2-b60b-a0bff243a35e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:15.296439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-312cf3fd-ee94-473c-9efd-b24f81300d6e req-de9b88bb-153a-4e13-b316-abc94d542c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6298d28-8cba-46d8-a809-bd0f81e18d58", "tag": "a14f5b04-fe69-47de-b23e-8ff9f06a4aae"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:15.308775 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0720e682-af5f-45d2-b60b-a0bff243a35e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:15.311485 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0720e682-af5f-45d2-b60b-a0bff243a35e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:15.312009 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0720e682-af5f-45d2-b60b-a0bff243a35e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:15.315478 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-312cf3fd-ee94-473c-9efd-b24f81300d6e req-de9b88bb-153a-4e13-b316-abc94d542c95 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:15.316224 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0720e682-af5f-45d2-b60b-a0bff243a35e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:15.316707 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0720e682-af5f-45d2-b60b-a0bff243a35e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:15.317337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0720e682-af5f-45d2-b60b-a0bff243a35e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:15.318929 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-312cf3fd-ee94-473c-9efd-b24f81300d6e req-de9b88bb-153a-4e13-b316-abc94d542c95 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:15.319683 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-312cf3fd-ee94-473c-9efd-b24f81300d6e req-de9b88bb-153a-4e13-b316-abc94d542c95 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:15.331633 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=100 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:15.351461 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-312cf3fd-ee94-473c-9efd-b24f81300d6e req-de9b88bb-153a-4e13-b316-abc94d542c95 service nova] Creating event network-changed:a14f5b04-fe69-47de-b23e-8ff9f06a4aae for instance f6298d28-8cba-46d8-a809-bd0f81e18d58 on hv-cinder-85931 Sep 26 18:06:15.376690 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-312cf3fd-ee94-473c-9efd-b24f81300d6e req-de9b88bb-153a-4e13-b316-abc94d542c95 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094564 Sep 26 18:06:15.398852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 193/376] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:06:15.398852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ccac45bf-0335-4f25-ae12-966385ce5793 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:15.398852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ccac45bf-0335-4f25-ae12-966385ce5793 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:15.403523 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ccac45bf-0335-4f25-ae12-966385ce5793 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:15.404211 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ccac45bf-0335-4f25-ae12-966385ce5793 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:15.404719 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ccac45bf-0335-4f25-ae12-966385ce5793 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:15.405853 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ccac45bf-0335-4f25-ae12-966385ce5793 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:15.406446 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ccac45bf-0335-4f25-ae12-966385ce5793 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:15.407320 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ccac45bf-0335-4f25-ae12-966385ce5793 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:15.432388 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=2 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:16.139942 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-0720e682-af5f-45d2-b60b-a0bff243a35e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:16.159537 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-0720e682-af5f-45d2-b60b-a0bff243a35e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1367 microversion: 2.1 time: 0.875540 Sep 26 18:06:16.160894 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 184/377] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:15 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1367 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:16.166478 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e067b85f-083d-41ff-bdb0-a031a111001f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:16.168560 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e067b85f-083d-41ff-bdb0-a031a111001f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:16.184684 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e067b85f-083d-41ff-bdb0-a031a111001f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:16.185451 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e067b85f-083d-41ff-bdb0-a031a111001f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:16.186072 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e067b85f-083d-41ff-bdb0-a031a111001f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:16.186971 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e067b85f-083d-41ff-bdb0-a031a111001f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:16.187737 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ccac45bf-0335-4f25-ae12-966385ce5793 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:16.189975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e067b85f-083d-41ff-bdb0-a031a111001f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:16.190858 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e067b85f-083d-41ff-bdb0-a031a111001f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:16.217984 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ccac45bf-0335-4f25-ae12-966385ce5793 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1313 microversion: 2.1 time: 0.822101 Sep 26 18:06:16.231700 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 194/378] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:15 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1313 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:16.449206 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e067b85f-083d-41ff-bdb0-a031a111001f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:16.463862 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e067b85f-083d-41ff-bdb0-a031a111001f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1303 microversion: 2.1 time: 0.300532 Sep 26 18:06:16.476185 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 185/379] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:16 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1303 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:17.209012 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a949a543-4a87-43ff-91a5-b8ed54da154d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:17.210319 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a949a543-4a87-43ff-91a5-b8ed54da154d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:17.217641 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=12 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:17.223186 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a949a543-4a87-43ff-91a5-b8ed54da154d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:17.224422 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a949a543-4a87-43ff-91a5-b8ed54da154d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:17.225436 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a949a543-4a87-43ff-91a5-b8ed54da154d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:17.226899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a949a543-4a87-43ff-91a5-b8ed54da154d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:17.228105 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a949a543-4a87-43ff-91a5-b8ed54da154d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:17.228999 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a949a543-4a87-43ff-91a5-b8ed54da154d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:17.266887 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-eaca49b5-9777-4657-9c6e-c4a147696f5b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:17.269080 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-eaca49b5-9777-4657-9c6e-c4a147696f5b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:17.275074 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=100 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:17.284209 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eaca49b5-9777-4657-9c6e-c4a147696f5b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:17.287289 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eaca49b5-9777-4657-9c6e-c4a147696f5b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:17.288700 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eaca49b5-9777-4657-9c6e-c4a147696f5b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:17.290355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eaca49b5-9777-4657-9c6e-c4a147696f5b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:17.291519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eaca49b5-9777-4657-9c6e-c4a147696f5b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:17.292461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eaca49b5-9777-4657-9c6e-c4a147696f5b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:18.479611 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a949a543-4a87-43ff-91a5-b8ed54da154d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:18.490417 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a949a543-4a87-43ff-91a5-b8ed54da154d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1367 microversion: 2.1 time: 1.288585 Sep 26 18:06:18.490998 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 195/380] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:17 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1367 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:18.497745 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a01257ac-b3ad-49e5-93b2-583795535095 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:18.498579 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a01257ac-b3ad-49e5-93b2-583795535095 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:18.508941 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a01257ac-b3ad-49e5-93b2-583795535095 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:18.510014 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a01257ac-b3ad-49e5-93b2-583795535095 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:18.510451 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a01257ac-b3ad-49e5-93b2-583795535095 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:18.511211 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a01257ac-b3ad-49e5-93b2-583795535095 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:18.511693 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a01257ac-b3ad-49e5-93b2-583795535095 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:18.512123 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a01257ac-b3ad-49e5-93b2-583795535095 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:18.581941 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-eaca49b5-9777-4657-9c6e-c4a147696f5b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:18.590021 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-eaca49b5-9777-4657-9c6e-c4a147696f5b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1313 microversion: 2.1 time: 1.330882 Sep 26 18:06:18.590599 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 186/381] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:17 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1313 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:18.839063 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a01257ac-b3ad-49e5-93b2-583795535095 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:18.848416 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a01257ac-b3ad-49e5-93b2-583795535095 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.356083 Sep 26 18:06:18.849004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 196/382] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:18 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:19.320456 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-e8bc1242-b7ac-4426-843e-8ac08bc45909 req-c5ad065b-a9b2-4770-a2f6-df6fb56dfd84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec0f212d-7662-44b8-b8f8-2bdb09383d23", "name": "network-vif-plugged", "status": "completed", "tag": "c3bcaded-511d-43f7-b35e-4fa6e8c47ecf"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:19.345574 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-e8bc1242-b7ac-4426-843e-8ac08bc45909 req-c5ad065b-a9b2-4770-a2f6-df6fb56dfd84 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:19.347135 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-e8bc1242-b7ac-4426-843e-8ac08bc45909 req-c5ad065b-a9b2-4770-a2f6-df6fb56dfd84 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:19.348032 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-e8bc1242-b7ac-4426-843e-8ac08bc45909 req-c5ad065b-a9b2-4770-a2f6-df6fb56dfd84 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:19.374403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-e8bc1242-b7ac-4426-843e-8ac08bc45909 req-c5ad065b-a9b2-4770-a2f6-df6fb56dfd84 service nova] Creating event network-vif-plugged:c3bcaded-511d-43f7-b35e-4fa6e8c47ecf for instance ec0f212d-7662-44b8-b8f8-2bdb09383d23 on hv-cinder-85931 Sep 26 18:06:19.384181 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-e8bc1242-b7ac-4426-843e-8ac08bc45909 req-c5ad065b-a9b2-4770-a2f6-df6fb56dfd84 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072361 Sep 26 18:06:19.386019 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 187/383] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:06:19.521857 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-186eeebb-ef9f-4a4c-9df8-6fadb349bd2b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:19.522741 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-186eeebb-ef9f-4a4c-9df8-6fadb349bd2b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:19.553195 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-186eeebb-ef9f-4a4c-9df8-6fadb349bd2b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:19.554077 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-186eeebb-ef9f-4a4c-9df8-6fadb349bd2b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:19.554894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-186eeebb-ef9f-4a4c-9df8-6fadb349bd2b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:19.556496 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-186eeebb-ef9f-4a4c-9df8-6fadb349bd2b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:19.557681 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-186eeebb-ef9f-4a4c-9df8-6fadb349bd2b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:19.558920 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-186eeebb-ef9f-4a4c-9df8-6fadb349bd2b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:19.622433 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5edb6526-826e-4840-baa4-92a6983953ab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:19.623814 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-5edb6526-826e-4840-baa4-92a6983953ab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:19.651238 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5edb6526-826e-4840-baa4-92a6983953ab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:19.652452 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5edb6526-826e-4840-baa4-92a6983953ab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:19.653091 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5edb6526-826e-4840-baa4-92a6983953ab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:19.653961 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5edb6526-826e-4840-baa4-92a6983953ab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:19.654874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5edb6526-826e-4840-baa4-92a6983953ab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:19.655557 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5edb6526-826e-4840-baa4-92a6983953ab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:19.943182 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-186eeebb-ef9f-4a4c-9df8-6fadb349bd2b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:19.960403 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-186eeebb-ef9f-4a4c-9df8-6fadb349bd2b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1557 microversion: 2.1 time: 0.446033 Sep 26 18:06:19.961357 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 197/384] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:19 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1557 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:19.989343 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c6ec6241-e4de-4fc0-9a03-70a42adf8f6b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:19.990734 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c6ec6241-e4de-4fc0-9a03-70a42adf8f6b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:20.001608 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c6ec6241-e4de-4fc0-9a03-70a42adf8f6b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:20.003934 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c6ec6241-e4de-4fc0-9a03-70a42adf8f6b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:20.004712 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c6ec6241-e4de-4fc0-9a03-70a42adf8f6b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:20.005724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5edb6526-826e-4840-baa4-92a6983953ab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:20.005974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c6ec6241-e4de-4fc0-9a03-70a42adf8f6b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:20.007027 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c6ec6241-e4de-4fc0-9a03-70a42adf8f6b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:20.007831 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c6ec6241-e4de-4fc0-9a03-70a42adf8f6b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:20.020635 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5edb6526-826e-4840-baa4-92a6983953ab tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1313 microversion: 2.1 time: 0.408871 Sep 26 18:06:20.021207 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 188/385] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:19 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:20.048162 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a787b766-bdee-4450-acc0-ccf05cb07875 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:20.054335 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a787b766-bdee-4450-acc0-ccf05cb07875 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:20.065555 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a787b766-bdee-4450-acc0-ccf05cb07875 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:20.066086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a787b766-bdee-4450-acc0-ccf05cb07875 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:20.066577 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a787b766-bdee-4450-acc0-ccf05cb07875 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:20.067458 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a787b766-bdee-4450-acc0-ccf05cb07875 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:20.067935 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a787b766-bdee-4450-acc0-ccf05cb07875 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:20.068533 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a787b766-bdee-4450-acc0-ccf05cb07875 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:20.183082 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a787b766-bdee-4450-acc0-ccf05cb07875 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144903 Sep 26 18:06:20.184043 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 189/386] 10.222.0.67 () {58 vars in 1275 bytes} [Mon Sep 26 18:06:20 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:20.311256 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c6ec6241-e4de-4fc0-9a03-70a42adf8f6b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:20.323026 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c6ec6241-e4de-4fc0-9a03-70a42adf8f6b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.354107 Sep 26 18:06:20.324195 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 198/387] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:19 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:21.050912 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-0f9eb3a7-6e9e-4e1e-b36b-6f47681bb656 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:21.064991 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-0f9eb3a7-6e9e-4e1e-b36b-6f47681bb656 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:21.086379 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0f9eb3a7-6e9e-4e1e-b36b-6f47681bb656 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:21.091143 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0f9eb3a7-6e9e-4e1e-b36b-6f47681bb656 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:21.092316 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0f9eb3a7-6e9e-4e1e-b36b-6f47681bb656 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:21.094341 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0f9eb3a7-6e9e-4e1e-b36b-6f47681bb656 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:21.096261 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0f9eb3a7-6e9e-4e1e-b36b-6f47681bb656 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:21.097329 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0f9eb3a7-6e9e-4e1e-b36b-6f47681bb656 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:21.363718 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4f764417-1c5c-4571-89f4-7d046d41944f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:21.364734 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4f764417-1c5c-4571-89f4-7d046d41944f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:21.373438 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4f764417-1c5c-4571-89f4-7d046d41944f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:21.374178 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4f764417-1c5c-4571-89f4-7d046d41944f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:21.374750 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4f764417-1c5c-4571-89f4-7d046d41944f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:21.376523 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4f764417-1c5c-4571-89f4-7d046d41944f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:21.377175 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4f764417-1c5c-4571-89f4-7d046d41944f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:21.377798 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4f764417-1c5c-4571-89f4-7d046d41944f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:22.081412 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-0f9eb3a7-6e9e-4e1e-b36b-6f47681bb656 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:22.097871 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-0f9eb3a7-6e9e-4e1e-b36b-6f47681bb656 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1313 microversion: 2.1 time: 1.054275 Sep 26 18:06:22.111074 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 190/388] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:21 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1313 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:22.127262 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-4f764417-1c5c-4571-89f4-7d046d41944f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:22.141380 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4f764417-1c5c-4571-89f4-7d046d41944f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.785360 Sep 26 18:06:22.144252 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 199/389] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:21 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:06:22.448441 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-fcfd3ec9-0554-4e72-976a-f575959e76d3 req-7c8db34a-a375-4a2f-9303-7652ecdfdee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a44a359c-9109-4982-a7d2-ba4622f28fc6", "tag": "9e6b89b3-2f73-4b79-94eb-c77bfe00bb5a"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:22.472546 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-fcfd3ec9-0554-4e72-976a-f575959e76d3 req-7c8db34a-a375-4a2f-9303-7652ecdfdee2 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:22.473486 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-fcfd3ec9-0554-4e72-976a-f575959e76d3 req-7c8db34a-a375-4a2f-9303-7652ecdfdee2 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:22.475171 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-fcfd3ec9-0554-4e72-976a-f575959e76d3 req-7c8db34a-a375-4a2f-9303-7652ecdfdee2 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:22.496890 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-fcfd3ec9-0554-4e72-976a-f575959e76d3 req-7c8db34a-a375-4a2f-9303-7652ecdfdee2 service nova] Creating event network-changed:9e6b89b3-2f73-4b79-94eb-c77bfe00bb5a for instance a44a359c-9109-4982-a7d2-ba4622f28fc6 on hv-cinder-85931 Sep 26 18:06:22.506217 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-fcfd3ec9-0554-4e72-976a-f575959e76d3 req-7c8db34a-a375-4a2f-9303-7652ecdfdee2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063379 Sep 26 18:06:22.507835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 191/390] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:23.165536 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-de146438-7345-4c6c-b51f-c17b9fb60235 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:23.181853 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-de146438-7345-4c6c-b51f-c17b9fb60235 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:23.185168 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-55ae7b08-a46b-43f6-afdc-06bdaaa684bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:23.187044 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-55ae7b08-a46b-43f6-afdc-06bdaaa684bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:23.201478 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de146438-7345-4c6c-b51f-c17b9fb60235 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:23.208188 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de146438-7345-4c6c-b51f-c17b9fb60235 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:23.208188 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de146438-7345-4c6c-b51f-c17b9fb60235 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:23.208188 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de146438-7345-4c6c-b51f-c17b9fb60235 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:23.208188 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de146438-7345-4c6c-b51f-c17b9fb60235 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:23.209575 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de146438-7345-4c6c-b51f-c17b9fb60235 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:23.209766 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-55ae7b08-a46b-43f6-afdc-06bdaaa684bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:23.209766 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-55ae7b08-a46b-43f6-afdc-06bdaaa684bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:23.209766 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-55ae7b08-a46b-43f6-afdc-06bdaaa684bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:23.210237 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-55ae7b08-a46b-43f6-afdc-06bdaaa684bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:23.210932 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-55ae7b08-a46b-43f6-afdc-06bdaaa684bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:23.212058 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-55ae7b08-a46b-43f6-afdc-06bdaaa684bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:23.942716 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-55ae7b08-a46b-43f6-afdc-06bdaaa684bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:23.955065 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-55ae7b08-a46b-43f6-afdc-06bdaaa684bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.778804 Sep 26 18:06:23.956182 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 192/391] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:23 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:24.041558 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-de146438-7345-4c6c-b51f-c17b9fb60235 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:24.061816 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-de146438-7345-4c6c-b51f-c17b9fb60235 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1496 microversion: 2.1 time: 0.922708 Sep 26 18:06:24.065239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 200/392] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:23 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1496 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:24.582494 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-eded2adf-a35c-484b-a9cd-0df05b992e54 req-ca3969be-ca5c-4743-a1a1-5e342606f130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a3d0414-434f-4d77-8bc1-57378672d4f8", "tag": "4db13c14-6478-4992-8d31-4a46754d492e"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:24.643331 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-eded2adf-a35c-484b-a9cd-0df05b992e54 req-ca3969be-ca5c-4743-a1a1-5e342606f130 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:24.644231 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-eded2adf-a35c-484b-a9cd-0df05b992e54 req-ca3969be-ca5c-4743-a1a1-5e342606f130 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:24.646170 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-eded2adf-a35c-484b-a9cd-0df05b992e54 req-ca3969be-ca5c-4743-a1a1-5e342606f130 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:24.692978 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-eded2adf-a35c-484b-a9cd-0df05b992e54 req-ca3969be-ca5c-4743-a1a1-5e342606f130 service nova] Creating event network-changed:4db13c14-6478-4992-8d31-4a46754d492e for instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 on hv-cinder-85931 Sep 26 18:06:24.713521 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-eded2adf-a35c-484b-a9cd-0df05b992e54 req-ca3969be-ca5c-4743-a1a1-5e342606f130 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143012 Sep 26 18:06:24.714849 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 193/393] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:25.002492 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f20e08cb-1bcd-4781-aea1-978ca7a0035e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:25.002492 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f20e08cb-1bcd-4781-aea1-978ca7a0035e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:25.017327 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f20e08cb-1bcd-4781-aea1-978ca7a0035e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:25.017833 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f20e08cb-1bcd-4781-aea1-978ca7a0035e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:25.018597 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f20e08cb-1bcd-4781-aea1-978ca7a0035e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:25.019908 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f20e08cb-1bcd-4781-aea1-978ca7a0035e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:25.020373 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f20e08cb-1bcd-4781-aea1-978ca7a0035e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:25.022534 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f20e08cb-1bcd-4781-aea1-978ca7a0035e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:25.403586 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f20e08cb-1bcd-4781-aea1-978ca7a0035e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:25.445951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f20e08cb-1bcd-4781-aea1-978ca7a0035e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.443775 Sep 26 18:06:25.448891 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 201/394] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:24 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:25.915981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-177d888a-7f63-456b-b926-23133fcc065a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:25.927373 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-177d888a-7f63-456b-b926-23133fcc065a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:25.944295 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-177d888a-7f63-456b-b926-23133fcc065a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:25.950959 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-177d888a-7f63-456b-b926-23133fcc065a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:25.950959 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-177d888a-7f63-456b-b926-23133fcc065a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:25.950959 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-177d888a-7f63-456b-b926-23133fcc065a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:25.950959 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-177d888a-7f63-456b-b926-23133fcc065a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:25.951607 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-177d888a-7f63-456b-b926-23133fcc065a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:26.026361 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-177d888a-7f63-456b-b926-23133fcc065a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Going to try to terminate instance {{(pid=121029) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:06:26.399193 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:26.482705 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-88d6adb8-dc4d-488f-ab09-b35ff09cea25 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:26.485757 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-88d6adb8-dc4d-488f-ab09-b35ff09cea25 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:26.512732 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-88d6adb8-dc4d-488f-ab09-b35ff09cea25 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:26.513491 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-88d6adb8-dc4d-488f-ab09-b35ff09cea25 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:26.514182 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-88d6adb8-dc4d-488f-ab09-b35ff09cea25 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:26.522417 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-88d6adb8-dc4d-488f-ab09-b35ff09cea25 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:26.523687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-88d6adb8-dc4d-488f-ab09-b35ff09cea25 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:26.524642 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-88d6adb8-dc4d-488f-ab09-b35ff09cea25 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:26.540284 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-177d888a-7f63-456b-b926-23133fcc065a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 204 len: 0 microversion: 2.1 time: 0.640555 Sep 26 18:06:26.541753 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 194/395] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:06:25 2022] DELETE /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:06:26.557746 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-3b2ebc08-a056-4f78-bc8f-89875911743d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:26.559242 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3b2ebc08-a056-4f78-bc8f-89875911743d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:26.590390 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3b2ebc08-a056-4f78-bc8f-89875911743d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:26.591528 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3b2ebc08-a056-4f78-bc8f-89875911743d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:26.592672 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3b2ebc08-a056-4f78-bc8f-89875911743d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:26.594759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3b2ebc08-a056-4f78-bc8f-89875911743d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:26.596226 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3b2ebc08-a056-4f78-bc8f-89875911743d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:26.597301 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3b2ebc08-a056-4f78-bc8f-89875911743d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:26.823620 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-88d6adb8-dc4d-488f-ab09-b35ff09cea25 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:26.838673 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-88d6adb8-dc4d-488f-ab09-b35ff09cea25 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.361542 Sep 26 18:06:26.839332 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 202/396] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:26 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:26.909207 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3b2ebc08-a056-4f78-bc8f-89875911743d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:26.933729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-3b2ebc08-a056-4f78-bc8f-89875911743d tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1502 microversion: 2.1 time: 0.381195 Sep 26 18:06:26.945359 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 195/397] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:26 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1502 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:27.884461 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9956a3ce-69a4-4710-8daa-a29592662243 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:27.884461 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9956a3ce-69a4-4710-8daa-a29592662243 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:27.901585 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9956a3ce-69a4-4710-8daa-a29592662243 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:27.902416 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9956a3ce-69a4-4710-8daa-a29592662243 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:27.903126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9956a3ce-69a4-4710-8daa-a29592662243 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:27.909621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9956a3ce-69a4-4710-8daa-a29592662243 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:27.910540 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9956a3ce-69a4-4710-8daa-a29592662243 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:27.911502 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9956a3ce-69a4-4710-8daa-a29592662243 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:28.006560 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9f2a4aeb-fb95-44d0-9877-55520beee198 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:28.007993 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9f2a4aeb-fb95-44d0-9877-55520beee198 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:28.021556 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9f2a4aeb-fb95-44d0-9877-55520beee198 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:28.023596 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9f2a4aeb-fb95-44d0-9877-55520beee198 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:28.026224 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9f2a4aeb-fb95-44d0-9877-55520beee198 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:28.027466 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9f2a4aeb-fb95-44d0-9877-55520beee198 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:28.028170 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9f2a4aeb-fb95-44d0-9877-55520beee198 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:28.028873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9f2a4aeb-fb95-44d0-9877-55520beee198 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:28.225039 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9956a3ce-69a4-4710-8daa-a29592662243 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:28.233854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9956a3ce-69a4-4710-8daa-a29592662243 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.360908 Sep 26 18:06:28.235141 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 203/398] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:27 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:28.326968 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9f2a4aeb-fb95-44d0-9877-55520beee198 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:28.347526 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9f2a4aeb-fb95-44d0-9877-55520beee198 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1502 microversion: 2.1 time: 0.354110 Sep 26 18:06:28.348500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 196/399] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:27 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1502 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:06:29.284250 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9418b2cc-79ca-4515-b6fc-b63d5a730e42 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:29.285338 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9418b2cc-79ca-4515-b6fc-b63d5a730e42 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:29.303380 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9418b2cc-79ca-4515-b6fc-b63d5a730e42 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:29.304806 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9418b2cc-79ca-4515-b6fc-b63d5a730e42 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:29.306118 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9418b2cc-79ca-4515-b6fc-b63d5a730e42 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:29.307457 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9418b2cc-79ca-4515-b6fc-b63d5a730e42 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:29.310481 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9418b2cc-79ca-4515-b6fc-b63d5a730e42 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:29.311372 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9418b2cc-79ca-4515-b6fc-b63d5a730e42 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:29.388067 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-4b2bcb2b-2cce-4639-a4e5-42fb5b9419e1 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:29.394099 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-4b2bcb2b-2cce-4639-a4e5-42fb5b9419e1 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:29.410853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b2bcb2b-2cce-4639-a4e5-42fb5b9419e1 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:29.411719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b2bcb2b-2cce-4639-a4e5-42fb5b9419e1 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:29.412379 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b2bcb2b-2cce-4639-a4e5-42fb5b9419e1 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:29.414195 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b2bcb2b-2cce-4639-a4e5-42fb5b9419e1 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:29.415321 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b2bcb2b-2cce-4639-a4e5-42fb5b9419e1 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:29.416096 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b2bcb2b-2cce-4639-a4e5-42fb5b9419e1 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:30.035936 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9418b2cc-79ca-4515-b6fc-b63d5a730e42 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:30.059355 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9418b2cc-79ca-4515-b6fc-b63d5a730e42 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.785196 Sep 26 18:06:30.060514 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 204/400] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:29 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:30.117767 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-4b2bcb2b-2cce-4639-a4e5-42fb5b9419e1 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:30.144068 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-4b2bcb2b-2cce-4639-a4e5-42fb5b9419e1 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1502 microversion: 2.1 time: 0.765071 Sep 26 18:06:30.145176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 197/401] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:29 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1502 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:31.102241 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ee3573dd-c6de-4ef7-ab74-5c5ff2fb0ee6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:31.109821 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ee3573dd-c6de-4ef7-ab74-5c5ff2fb0ee6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:31.136425 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee3573dd-c6de-4ef7-ab74-5c5ff2fb0ee6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:31.141061 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee3573dd-c6de-4ef7-ab74-5c5ff2fb0ee6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:31.141061 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee3573dd-c6de-4ef7-ab74-5c5ff2fb0ee6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:31.141061 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee3573dd-c6de-4ef7-ab74-5c5ff2fb0ee6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:31.141061 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee3573dd-c6de-4ef7-ab74-5c5ff2fb0ee6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:31.141716 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ee3573dd-c6de-4ef7-ab74-5c5ff2fb0ee6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:31.192015 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-75885b36-5c64-4e50-9ae6-f2ba07a62c63 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:31.200176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-75885b36-5c64-4e50-9ae6-f2ba07a62c63 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:31.263870 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75885b36-5c64-4e50-9ae6-f2ba07a62c63 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:31.266323 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75885b36-5c64-4e50-9ae6-f2ba07a62c63 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:31.267339 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75885b36-5c64-4e50-9ae6-f2ba07a62c63 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:31.288757 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75885b36-5c64-4e50-9ae6-f2ba07a62c63 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:31.288757 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75885b36-5c64-4e50-9ae6-f2ba07a62c63 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:31.288757 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75885b36-5c64-4e50-9ae6-f2ba07a62c63 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:31.646291 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ee3573dd-c6de-4ef7-ab74-5c5ff2fb0ee6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:31.665114 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ee3573dd-c6de-4ef7-ab74-5c5ff2fb0ee6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.569847 Sep 26 18:06:31.684746 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 205/402] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:31 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:31.727528 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-75885b36-5c64-4e50-9ae6-f2ba07a62c63 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:31.745463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-75885b36-5c64-4e50-9ae6-f2ba07a62c63 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1502 microversion: 2.1 time: 0.576710 Sep 26 18:06:31.746226 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 198/403] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:31 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1502 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:32.699232 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-45833da2-9bc2-499a-ab80-0bdcf43b60ae tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:32.700727 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-45833da2-9bc2-499a-ab80-0bdcf43b60ae tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:32.711149 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-45833da2-9bc2-499a-ab80-0bdcf43b60ae tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:32.711531 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-45833da2-9bc2-499a-ab80-0bdcf43b60ae tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:32.712511 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-45833da2-9bc2-499a-ab80-0bdcf43b60ae tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:32.713402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-45833da2-9bc2-499a-ab80-0bdcf43b60ae tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:32.714008 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-45833da2-9bc2-499a-ab80-0bdcf43b60ae tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:32.714592 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-45833da2-9bc2-499a-ab80-0bdcf43b60ae tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:32.780115 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5236712e-d165-4a3d-9308-564a315c6858 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:32.783940 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-5236712e-d165-4a3d-9308-564a315c6858 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:32.790096 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5236712e-d165-4a3d-9308-564a315c6858 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:32.790405 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5236712e-d165-4a3d-9308-564a315c6858 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:32.790855 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5236712e-d165-4a3d-9308-564a315c6858 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:32.791571 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5236712e-d165-4a3d-9308-564a315c6858 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:32.792383 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5236712e-d165-4a3d-9308-564a315c6858 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:32.793814 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5236712e-d165-4a3d-9308-564a315c6858 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:32.964062 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-45833da2-9bc2-499a-ab80-0bdcf43b60ae tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:32.996733 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-45833da2-9bc2-499a-ab80-0bdcf43b60ae tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.302090 Sep 26 18:06:32.998063 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 206/404] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:32 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:33.006059 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5236712e-d165-4a3d-9308-564a315c6858 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:33.015432 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5236712e-d165-4a3d-9308-564a315c6858 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1502 microversion: 2.1 time: 0.246045 Sep 26 18:06:33.016812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 199/405] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:32 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1502 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:34.024851 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-05803f1a-ec67-4b8c-9094-c28790f13bc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:34.025974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-05803f1a-ec67-4b8c-9094-c28790f13bc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:34.036809 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-05803f1a-ec67-4b8c-9094-c28790f13bc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:34.037304 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-05803f1a-ec67-4b8c-9094-c28790f13bc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:34.037922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-05803f1a-ec67-4b8c-9094-c28790f13bc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:34.039085 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-05803f1a-ec67-4b8c-9094-c28790f13bc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:34.039737 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-05803f1a-ec67-4b8c-9094-c28790f13bc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:34.040325 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-05803f1a-ec67-4b8c-9094-c28790f13bc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:34.052335 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-3a5a818b-3abf-4e98-a6b6-5cced5d9e748 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:34.053491 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3a5a818b-3abf-4e98-a6b6-5cced5d9e748 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:34.060736 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3a5a818b-3abf-4e98-a6b6-5cced5d9e748 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:34.061366 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3a5a818b-3abf-4e98-a6b6-5cced5d9e748 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:34.064208 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3a5a818b-3abf-4e98-a6b6-5cced5d9e748 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:34.064208 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3a5a818b-3abf-4e98-a6b6-5cced5d9e748 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:34.064208 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3a5a818b-3abf-4e98-a6b6-5cced5d9e748 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:34.064208 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3a5a818b-3abf-4e98-a6b6-5cced5d9e748 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:34.312240 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-05803f1a-ec67-4b8c-9094-c28790f13bc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:34.314357 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3a5a818b-3abf-4e98-a6b6-5cced5d9e748 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:34.322529 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-3a5a818b-3abf-4e98-a6b6-5cced5d9e748 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1502 microversion: 2.1 time: 0.282528 Sep 26 18:06:34.324859 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-05803f1a-ec67-4b8c-9094-c28790f13bc6 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.306707 Sep 26 18:06:34.325614 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 207/406] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:34 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:34.336109 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 200/407] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:34 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1502 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:35.357669 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9a219652-1a78-4d22-b324-8970ae4aead2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:35.360179 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9a219652-1a78-4d22-b324-8970ae4aead2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:35.360644 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-cd0a0478-a910-4c23-923e-bca01d1308bc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:35.361866 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-cd0a0478-a910-4c23-923e-bca01d1308bc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:35.372161 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a219652-1a78-4d22-b324-8970ae4aead2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:35.373064 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a219652-1a78-4d22-b324-8970ae4aead2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:35.375049 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cd0a0478-a910-4c23-923e-bca01d1308bc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:35.376013 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cd0a0478-a910-4c23-923e-bca01d1308bc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:35.376985 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cd0a0478-a910-4c23-923e-bca01d1308bc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:35.377159 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a219652-1a78-4d22-b324-8970ae4aead2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:35.377776 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a219652-1a78-4d22-b324-8970ae4aead2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:35.378246 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a219652-1a78-4d22-b324-8970ae4aead2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:35.380085 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a219652-1a78-4d22-b324-8970ae4aead2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:35.383986 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cd0a0478-a910-4c23-923e-bca01d1308bc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:35.385025 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cd0a0478-a910-4c23-923e-bca01d1308bc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:35.385751 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cd0a0478-a910-4c23-923e-bca01d1308bc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:35.432159 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:35.809230 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-cd0a0478-a910-4c23-923e-bca01d1308bc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:35.844810 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9a219652-1a78-4d22-b324-8970ae4aead2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:35.862753 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-cd0a0478-a910-4c23-923e-bca01d1308bc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.489999 Sep 26 18:06:35.863636 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 201/408] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:35 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:35.866019 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9a219652-1a78-4d22-b324-8970ae4aead2 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1502 microversion: 2.1 time: 0.514705 Sep 26 18:06:35.866595 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 208/409] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:35 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1502 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:06:35.873983 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-31fb622e-46d2-410c-8fad-5e385ddcb82c req-39d8bd44-7c8f-4643-98b2-d015af590c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec0f212d-7662-44b8-b8f8-2bdb09383d23", "name": "network-vif-deleted", "tag": "c3bcaded-511d-43f7-b35e-4fa6e8c47ecf"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:35.888997 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-31fb622e-46d2-410c-8fad-5e385ddcb82c req-39d8bd44-7c8f-4643-98b2-d015af590c5b service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:35.889726 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-31fb622e-46d2-410c-8fad-5e385ddcb82c req-39d8bd44-7c8f-4643-98b2-d015af590c5b service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:35.890156 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-31fb622e-46d2-410c-8fad-5e385ddcb82c req-39d8bd44-7c8f-4643-98b2-d015af590c5b service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:35.908153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-31fb622e-46d2-410c-8fad-5e385ddcb82c req-39d8bd44-7c8f-4643-98b2-d015af590c5b service nova] Creating event network-vif-deleted:c3bcaded-511d-43f7-b35e-4fa6e8c47ecf for instance ec0f212d-7662-44b8-b8f8-2bdb09383d23 on hv-cinder-85931 Sep 26 18:06:35.914730 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-31fb622e-46d2-410c-8fad-5e385ddcb82c req-39d8bd44-7c8f-4643-98b2-d015af590c5b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046575 Sep 26 18:06:35.920122 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 202/410] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:36.365074 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-2fa3b694-2111-45d3-8c5c-6feb14ba1eb5 req-0ba67202-65cf-4892-83c2-dcf95a1d9af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44a359c-9109-4982-a7d2-ba4622f28fc6", "name": "network-vif-plugged", "status": "completed", "tag": "9e6b89b3-2f73-4b79-94eb-c77bfe00bb5a"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:36.386341 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-2fa3b694-2111-45d3-8c5c-6feb14ba1eb5 req-0ba67202-65cf-4892-83c2-dcf95a1d9af0 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:36.386823 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-2fa3b694-2111-45d3-8c5c-6feb14ba1eb5 req-0ba67202-65cf-4892-83c2-dcf95a1d9af0 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:36.387253 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-2fa3b694-2111-45d3-8c5c-6feb14ba1eb5 req-0ba67202-65cf-4892-83c2-dcf95a1d9af0 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:36.450217 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-2fa3b694-2111-45d3-8c5c-6feb14ba1eb5 req-0ba67202-65cf-4892-83c2-dcf95a1d9af0 service nova] Creating event network-vif-plugged:9e6b89b3-2f73-4b79-94eb-c77bfe00bb5a for instance a44a359c-9109-4982-a7d2-ba4622f28fc6 on hv-cinder-85931 Sep 26 18:06:36.456355 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-2fa3b694-2111-45d3-8c5c-6feb14ba1eb5 req-0ba67202-65cf-4892-83c2-dcf95a1d9af0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098273 Sep 26 18:06:36.457270 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 209/411] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:36.897838 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-0374d488-dc16-4977-b863-eb0f78d8a8d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:36.899264 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f1bebafb-5289-43c5-8edd-c538a7457a4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:36.900794 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-0374d488-dc16-4977-b863-eb0f78d8a8d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:36.903524 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f1bebafb-5289-43c5-8edd-c538a7457a4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:36.914083 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0374d488-dc16-4977-b863-eb0f78d8a8d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:36.914501 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0374d488-dc16-4977-b863-eb0f78d8a8d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:36.917887 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f1bebafb-5289-43c5-8edd-c538a7457a4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:36.921305 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f1bebafb-5289-43c5-8edd-c538a7457a4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:36.921305 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f1bebafb-5289-43c5-8edd-c538a7457a4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:36.921305 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f1bebafb-5289-43c5-8edd-c538a7457a4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:36.921305 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f1bebafb-5289-43c5-8edd-c538a7457a4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:36.921935 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f1bebafb-5289-43c5-8edd-c538a7457a4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:36.923199 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0374d488-dc16-4977-b863-eb0f78d8a8d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:36.924458 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0374d488-dc16-4977-b863-eb0f78d8a8d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:36.925129 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0374d488-dc16-4977-b863-eb0f78d8a8d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:36.925558 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0374d488-dc16-4977-b863-eb0f78d8a8d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:36.992227 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0374d488-dc16-4977-b863-eb0f78d8a8d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:36.993071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0374d488-dc16-4977-b863-eb0f78d8a8d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:36.993724 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0374d488-dc16-4977-b863-eb0f78d8a8d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:36.994330 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-0374d488-dc16-4977-b863-eb0f78d8a8d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lazy-loading 'fault' on Instance uuid ec0f212d-7662-44b8-b8f8-2bdb09383d23 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:06:37.069127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-0374d488-dc16-4977-b863-eb0f78d8a8d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:37.084489 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-0374d488-dc16-4977-b863-eb0f78d8a8d3 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1303 microversion: 2.1 time: 0.190282 Sep 26 18:06:37.086118 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 210/412] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:36 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1303 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:37.379394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f1bebafb-5289-43c5-8edd-c538a7457a4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:37.393700 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f1bebafb-5289-43c5-8edd-c538a7457a4b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.506425 Sep 26 18:06:37.409281 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 203/413] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:36 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:38.126933 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a392ceb3-8afe-4c56-96c4-ad68bc19b876 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:38.127581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a392ceb3-8afe-4c56-96c4-ad68bc19b876 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:38.134741 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a392ceb3-8afe-4c56-96c4-ad68bc19b876 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:38.136038 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a392ceb3-8afe-4c56-96c4-ad68bc19b876 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:38.136565 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a392ceb3-8afe-4c56-96c4-ad68bc19b876 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:38.137426 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a392ceb3-8afe-4c56-96c4-ad68bc19b876 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:38.138074 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a392ceb3-8afe-4c56-96c4-ad68bc19b876 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:38.138496 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a392ceb3-8afe-4c56-96c4-ad68bc19b876 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:38.178828 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a392ceb3-8afe-4c56-96c4-ad68bc19b876 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:38.181064 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a392ceb3-8afe-4c56-96c4-ad68bc19b876 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:38.182654 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a392ceb3-8afe-4c56-96c4-ad68bc19b876 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:38.183404 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-a392ceb3-8afe-4c56-96c4-ad68bc19b876 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lazy-loading 'fault' on Instance uuid ec0f212d-7662-44b8-b8f8-2bdb09383d23 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:06:38.249214 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a392ceb3-8afe-4c56-96c4-ad68bc19b876 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:38.261484 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a392ceb3-8afe-4c56-96c4-ad68bc19b876 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1303 microversion: 2.1 time: 0.139147 Sep 26 18:06:38.262068 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 211/414] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:38 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1303 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:38.417919 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c884a513-2551-4a15-900e-32c44f5eb052 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:38.418563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c884a513-2551-4a15-900e-32c44f5eb052 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:38.427338 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c884a513-2551-4a15-900e-32c44f5eb052 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:38.427890 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c884a513-2551-4a15-900e-32c44f5eb052 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:38.428303 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c884a513-2551-4a15-900e-32c44f5eb052 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:38.429236 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c884a513-2551-4a15-900e-32c44f5eb052 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:38.429862 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c884a513-2551-4a15-900e-32c44f5eb052 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:38.430290 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c884a513-2551-4a15-900e-32c44f5eb052 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:38.583695 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c884a513-2551-4a15-900e-32c44f5eb052 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:38.591440 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c884a513-2551-4a15-900e-32c44f5eb052 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.177447 Sep 26 18:06:38.592005 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 204/415] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:38 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:39.288175 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9f9e0ec1-1ccf-47dc-8312-7127b2c5f136 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:39.288774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9f9e0ec1-1ccf-47dc-8312-7127b2c5f136 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:39.298170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9f9e0ec1-1ccf-47dc-8312-7127b2c5f136 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:39.299045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9f9e0ec1-1ccf-47dc-8312-7127b2c5f136 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:39.299746 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9f9e0ec1-1ccf-47dc-8312-7127b2c5f136 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:39.300537 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9f9e0ec1-1ccf-47dc-8312-7127b2c5f136 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:39.301098 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9f9e0ec1-1ccf-47dc-8312-7127b2c5f136 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:39.302818 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9f9e0ec1-1ccf-47dc-8312-7127b2c5f136 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:39.323324 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=100 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:39.338463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9f9e0ec1-1ccf-47dc-8312-7127b2c5f136 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:39.338944 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9f9e0ec1-1ccf-47dc-8312-7127b2c5f136 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:39.339373 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9f9e0ec1-1ccf-47dc-8312-7127b2c5f136 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:39.340077 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-9f9e0ec1-1ccf-47dc-8312-7127b2c5f136 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lazy-loading 'fault' on Instance uuid ec0f212d-7662-44b8-b8f8-2bdb09383d23 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:06:39.404843 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9f9e0ec1-1ccf-47dc-8312-7127b2c5f136 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:39.420569 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9f9e0ec1-1ccf-47dc-8312-7127b2c5f136 tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1303 microversion: 2.1 time: 0.137899 Sep 26 18:06:39.423175 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 212/416] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:39 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1303 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:39.615941 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1d740bc7-033f-4858-a92c-efdacbcb5220 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:39.616540 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1d740bc7-033f-4858-a92c-efdacbcb5220 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:39.629976 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1d740bc7-033f-4858-a92c-efdacbcb5220 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:39.629976 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1d740bc7-033f-4858-a92c-efdacbcb5220 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:39.629976 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1d740bc7-033f-4858-a92c-efdacbcb5220 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:39.629976 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1d740bc7-033f-4858-a92c-efdacbcb5220 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:39.630462 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1d740bc7-033f-4858-a92c-efdacbcb5220 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:39.630462 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1d740bc7-033f-4858-a92c-efdacbcb5220 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:39.894830 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1d740bc7-033f-4858-a92c-efdacbcb5220 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:39.905180 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1d740bc7-033f-4858-a92c-efdacbcb5220 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.293784 Sep 26 18:06:39.929180 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 205/417] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:39 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:40.449384 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d70015db-d950-4257-a175-3fa75b2fe76a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:40.450101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d70015db-d950-4257-a175-3fa75b2fe76a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:40.456819 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d70015db-d950-4257-a175-3fa75b2fe76a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:40.457319 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d70015db-d950-4257-a175-3fa75b2fe76a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:40.457814 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d70015db-d950-4257-a175-3fa75b2fe76a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:40.458523 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d70015db-d950-4257-a175-3fa75b2fe76a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:40.458986 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d70015db-d950-4257-a175-3fa75b2fe76a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:40.459411 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d70015db-d950-4257-a175-3fa75b2fe76a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:40.496323 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d70015db-d950-4257-a175-3fa75b2fe76a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:40.497043 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d70015db-d950-4257-a175-3fa75b2fe76a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:40.497656 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d70015db-d950-4257-a175-3fa75b2fe76a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:40.498307 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-d70015db-d950-4257-a175-3fa75b2fe76a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lazy-loading 'fault' on Instance uuid ec0f212d-7662-44b8-b8f8-2bdb09383d23 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:06:40.506400 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-7321d7d9-c430-476b-a335-319ed4d51633 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Action: 'create', calling method: .version_select at 0x7f3a74b0c550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1527584654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI19ApJr6/wVvxEntOoOO7+Bft/f20lgLZERHhbbwnAWG8080CM2EFMh7peXOqXPzNk4wQc7XhhP/YSdhfGOxkO2A061NkMDFFP38HFf+pYukhiBRy8p4wiQrEmit/jjYg=="}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:40.529327 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-7321d7d9-c430-476b-a335-319ed4d51633 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Getting quotas for project 08e4bf78b8f043a598a4b6a1d8acc219. Resources: {'key_pairs'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:06:40.535748 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-7321d7d9-c430-476b-a335-319ed4d51633 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Getting quotas for user 183fe84502664f49a701a5e9eb4f6cd7 and project 08e4bf78b8f043a598a4b6a1d8acc219. Resources: {'key_pairs'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:06:40.553084 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d70015db-d950-4257-a175-3fa75b2fe76a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:40.562839 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d70015db-d950-4257-a175-3fa75b2fe76a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1303 microversion: 2.1 time: 0.117504 Sep 26 18:06:40.563595 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 206/418] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:40 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:06:40.696172 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-7321d7d9-c430-476b-a335-319ed4d51633 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.429412 Sep 26 18:06:40.700434 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 213/419] 10.222.0.67 () {60 vars in 1159 bytes} [Mon Sep 26 18:06:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:40.930478 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f8c2a569-6d43-4c49-8cb3-2cf3305b3883 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:40.931095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f8c2a569-6d43-4c49-8cb3-2cf3305b3883 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:40.942332 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8c2a569-6d43-4c49-8cb3-2cf3305b3883 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:40.942831 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8c2a569-6d43-4c49-8cb3-2cf3305b3883 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:40.943270 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8c2a569-6d43-4c49-8cb3-2cf3305b3883 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:40.944027 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8c2a569-6d43-4c49-8cb3-2cf3305b3883 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:40.944542 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8c2a569-6d43-4c49-8cb3-2cf3305b3883 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:40.944975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8c2a569-6d43-4c49-8cb3-2cf3305b3883 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:41.133809 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f8c2a569-6d43-4c49-8cb3-2cf3305b3883 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:41.156898 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f8c2a569-6d43-4c49-8cb3-2cf3305b3883 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.229488 Sep 26 18:06:41.176005 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 207/420] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:40 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:41.600756 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2b58c408-0a83-41c6-9e6d-b2524373997b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:41.600756 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2b58c408-0a83-41c6-9e6d-b2524373997b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:41.601708 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2b58c408-0a83-41c6-9e6d-b2524373997b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:41.602421 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2b58c408-0a83-41c6-9e6d-b2524373997b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:41.603019 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2b58c408-0a83-41c6-9e6d-b2524373997b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:41.604160 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2b58c408-0a83-41c6-9e6d-b2524373997b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:41.604628 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2b58c408-0a83-41c6-9e6d-b2524373997b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:41.605083 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2b58c408-0a83-41c6-9e6d-b2524373997b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:41.649747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2b58c408-0a83-41c6-9e6d-b2524373997b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:41.650288 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2b58c408-0a83-41c6-9e6d-b2524373997b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:41.654165 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2b58c408-0a83-41c6-9e6d-b2524373997b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:41.654165 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-2b58c408-0a83-41c6-9e6d-b2524373997b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lazy-loading 'fault' on Instance uuid ec0f212d-7662-44b8-b8f8-2bdb09383d23 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:06:41.725140 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2b58c408-0a83-41c6-9e6d-b2524373997b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:41.733328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2b58c408-0a83-41c6-9e6d-b2524373997b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1303 microversion: 2.1 time: 0.146761 Sep 26 18:06:41.737593 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 214/421] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:41 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1303 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:42.186828 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-4f997a75-bfa1-4cfe-8d6a-d9b200ee3723 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:42.188618 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-4f997a75-bfa1-4cfe-8d6a-d9b200ee3723 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:42.201852 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4f997a75-bfa1-4cfe-8d6a-d9b200ee3723 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:42.202403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4f997a75-bfa1-4cfe-8d6a-d9b200ee3723 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:42.202853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4f997a75-bfa1-4cfe-8d6a-d9b200ee3723 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:42.203993 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4f997a75-bfa1-4cfe-8d6a-d9b200ee3723 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:42.204167 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4f997a75-bfa1-4cfe-8d6a-d9b200ee3723 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:42.204528 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4f997a75-bfa1-4cfe-8d6a-d9b200ee3723 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:42.389010 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-4f997a75-bfa1-4cfe-8d6a-d9b200ee3723 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:42.400840 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-4f997a75-bfa1-4cfe-8d6a-d9b200ee3723 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1371 microversion: 2.1 time: 0.224144 Sep 26 18:06:42.415762 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 208/422] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:42 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:42.770974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-0a74b1ca-9546-46c3-abef-c2c44a5b709b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:42.771662 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-0a74b1ca-9546-46c3-abef-c2c44a5b709b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:42.779938 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0a74b1ca-9546-46c3-abef-c2c44a5b709b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:42.780751 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0a74b1ca-9546-46c3-abef-c2c44a5b709b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:42.782045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0a74b1ca-9546-46c3-abef-c2c44a5b709b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:42.783283 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0a74b1ca-9546-46c3-abef-c2c44a5b709b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:42.784116 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0a74b1ca-9546-46c3-abef-c2c44a5b709b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:42.784876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0a74b1ca-9546-46c3-abef-c2c44a5b709b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:42.823240 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0a74b1ca-9546-46c3-abef-c2c44a5b709b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:42.823968 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0a74b1ca-9546-46c3-abef-c2c44a5b709b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:42.824443 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0a74b1ca-9546-46c3-abef-c2c44a5b709b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:42.824943 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-0a74b1ca-9546-46c3-abef-c2c44a5b709b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lazy-loading 'fault' on Instance uuid ec0f212d-7662-44b8-b8f8-2bdb09383d23 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:06:42.876587 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-0a74b1ca-9546-46c3-abef-c2c44a5b709b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349bc0a30f324816804e596c937e3da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e42dd8f6ff445cb7d44b0b0ce94fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:42.889317 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-0a74b1ca-9546-46c3-abef-c2c44a5b709b tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 200 len: 1303 microversion: 2.1 time: 0.122340 Sep 26 18:06:42.889818 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 215/423] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:42 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:06:43.429260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c2c6a917-b86f-49fa-8a27-9cb4ea979496 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:43.430280 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c2c6a917-b86f-49fa-8a27-9cb4ea979496 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:43.440759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c2c6a917-b86f-49fa-8a27-9cb4ea979496 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:43.441267 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c2c6a917-b86f-49fa-8a27-9cb4ea979496 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:43.441716 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c2c6a917-b86f-49fa-8a27-9cb4ea979496 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:43.442510 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c2c6a917-b86f-49fa-8a27-9cb4ea979496 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:43.442980 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c2c6a917-b86f-49fa-8a27-9cb4ea979496 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:43.443409 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c2c6a917-b86f-49fa-8a27-9cb4ea979496 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:43.682501 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c2c6a917-b86f-49fa-8a27-9cb4ea979496 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:06:43.692192 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c2c6a917-b86f-49fa-8a27-9cb4ea979496 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1564 microversion: 2.1 time: 0.271625 Sep 26 18:06:43.692782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 209/424] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:43 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1564 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:06:43.763959 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b6f296e2-104a-476a-b6bc-346f7b5ff4e1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:43.763959 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b6f296e2-104a-476a-b6bc-346f7b5ff4e1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:43.780867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6f296e2-104a-476a-b6bc-346f7b5ff4e1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:43.783731 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6f296e2-104a-476a-b6bc-346f7b5ff4e1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:43.791170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6f296e2-104a-476a-b6bc-346f7b5ff4e1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:43.793504 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6f296e2-104a-476a-b6bc-346f7b5ff4e1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:43.797054 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6f296e2-104a-476a-b6bc-346f7b5ff4e1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:43.797929 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b6f296e2-104a-476a-b6bc-346f7b5ff4e1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:43.913445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bb9aa5c4-bdf3-4cf2-a588-0ba944245d3a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:06:43.914401 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-bb9aa5c4-bdf3-4cf2-a588-0ba944245d3a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] [instance: ec0f212d-7662-44b8-b8f8-2bdb09383d23] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:06:43.921135 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bb9aa5c4-bdf3-4cf2-a588-0ba944245d3a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:43.929108 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bb9aa5c4-bdf3-4cf2-a588-0ba944245d3a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:43.929108 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bb9aa5c4-bdf3-4cf2-a588-0ba944245d3a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:43.929108 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bb9aa5c4-bdf3-4cf2-a588-0ba944245d3a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:43.929108 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bb9aa5c4-bdf3-4cf2-a588-0ba944245d3a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:43.929507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bb9aa5c4-bdf3-4cf2-a588-0ba944245d3a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:43.943771 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b6f296e2-104a-476a-b6bc-346f7b5ff4e1 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.205785 Sep 26 18:06:43.944361 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 216/425] 10.222.0.67 () {58 vars in 1275 bytes} [Mon Sep 26 18:06:43 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:06:43.961577 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-bb9aa5c4-bdf3-4cf2-a588-0ba944245d3a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] HTTP exception thrown: Instance ec0f212d-7662-44b8-b8f8-2bdb09383d23 could not be found. Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bb9aa5c4-bdf3-4cf2-a588-0ba944245d3a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Request method failure captured: Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 HTTP/1.1 Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMenPpBL2nBIMHft39K-M5houcBmP-Pv3AOwXsrNCtarL-jC0Wm9t9q8JRzsKok5OGa1Akhr4fG3JLF1LBqWFvNLO_gfR119vKwfH0lfguIg7c9f-F-prFm_wKSwm5XgvOyzL_oLDja-L8eh1W22tH2Za66MvdU6AUNb-REzQZZflwxA Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: 31e42dd8f6ff445cb7d44b0b0ce94fc2 Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-VolumesActionsTest-920156870 Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:06:43.965260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:06:43.966865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/31e42dd8f6ff445cb7d44b0b0ce94fc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/31e42dd8f6ff445cb7d44b0b0ce94fc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_31e42dd8f6ff445cb7d44b0b0ce94fc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/31e42dd8f6ff445cb7d44b0b0ce94fc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:06:43.966865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-VolumesActionsTest-920156870 Sep 26 18:06:43.966865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: 31e42dd8f6ff445cb7d44b0b0ce94fc2 Sep 26 18:06:43.966865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-VolumesActionsTest-920156870 Sep 26 18:06:43.966865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-VolumesActionsTest-920156870-project Sep 26 18:06:43.966865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:06:43.966865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:06:43.966865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 349bc0a30f324816804e596c937e3da0 Sep 26 18:06:43.966865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-VolumesActionsTest-920156870-project Sep 26 18:06:43.966865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:06:43.966865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance ec0f212d-7662-44b8-b8f8-2bdb09383d23 could not be found. Sep 26 18:06:43.966865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': 'ec0f212d-7662-44b8-b8f8-2bdb09383d23'} Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec0f212d-7662-44b8-b8f8-2bdb09383d23 could not be found. Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:06:43.968435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec0f212d-7662-44b8-b8f8-2bdb09383d23 could not be found. Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec0f212d-7662-44b8-b8f8-2bdb09383d23 could not be found. Sep 26 18:06:43.970519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:06:43.972020 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bb9aa5c4-bdf3-4cf2-a588-0ba944245d3a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] Returning 404 to user: Instance ec0f212d-7662-44b8-b8f8-2bdb09383d23 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:06:43.972020 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bb9aa5c4-bdf3-4cf2-a588-0ba944245d3a tempest-VolumesActionsTest-920156870 tempest-VolumesActionsTest-920156870-project] 10.222.0.67 "GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23" status: 404 len: 111 microversion: 2.1 time: 0.058229 Sep 26 18:06:43.972020 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 210/426] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:06:43 2022] GET /compute/v2.1/servers/ec0f212d-7662-44b8-b8f8-2bdb09383d23 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:06:45.707015 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-0e4ab8e5-610f-4643-8195-5bf9b1b2018a req-a05c2e5b-236b-4e9b-851a-a6bcc36fea31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a44a359c-9109-4982-a7d2-ba4622f28fc6", "tag": "9e6b89b3-2f73-4b79-94eb-c77bfe00bb5a"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:06:45.734952 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-0e4ab8e5-610f-4643-8195-5bf9b1b2018a req-a05c2e5b-236b-4e9b-851a-a6bcc36fea31 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:06:45.736041 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-0e4ab8e5-610f-4643-8195-5bf9b1b2018a req-a05c2e5b-236b-4e9b-851a-a6bcc36fea31 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:06:45.736853 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-0e4ab8e5-610f-4643-8195-5bf9b1b2018a req-a05c2e5b-236b-4e9b-851a-a6bcc36fea31 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:06:45.785826 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-0e4ab8e5-610f-4643-8195-5bf9b1b2018a req-a05c2e5b-236b-4e9b-851a-a6bcc36fea31 service nova] Creating event network-changed:9e6b89b3-2f73-4b79-94eb-c77bfe00bb5a for instance a44a359c-9109-4982-a7d2-ba4622f28fc6 on hv-cinder-85931 Sep 26 18:06:45.797292 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-0e4ab8e5-610f-4643-8195-5bf9b1b2018a req-a05c2e5b-236b-4e9b-851a-a6bcc36fea31 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129832 Sep 26 18:06:45.800188 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 217/427] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:07:12.494406 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-6e6c9092-0564-4ba5-a177-cbc14005c656 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:12.501874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-6e6c9092-0564-4ba5-a177-cbc14005c656 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:12.501874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:12.502888 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=50 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:12.510765 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6e6c9092-0564-4ba5-a177-cbc14005c656 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:12.512264 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6e6c9092-0564-4ba5-a177-cbc14005c656 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:12.513545 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6e6c9092-0564-4ba5-a177-cbc14005c656 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:12.518079 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6e6c9092-0564-4ba5-a177-cbc14005c656 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:12.518079 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6e6c9092-0564-4ba5-a177-cbc14005c656 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:12.518079 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6e6c9092-0564-4ba5-a177-cbc14005c656 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:12.560435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-6e6c9092-0564-4ba5-a177-cbc14005c656 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/ips" status: 200 len: 150 microversion: 2.20 time: 0.072161 Sep 26 18:07:12.564375 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 211/428] 10.222.0.67 () {60 vars in 1289 bytes} [Mon Sep 26 18:07:12 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/ips => generated 150 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 18:07:18.199310 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=4 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:18.200624 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:18.201275 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=28 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:18.205840 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2653e9e3-1e2f-482b-bb61-8d8ae11edb35 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:07:18.206474 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2653e9e3-1e2f-482b-bb61-8d8ae11edb35 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:18.213490 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2653e9e3-1e2f-482b-bb61-8d8ae11edb35 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:18.214250 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2653e9e3-1e2f-482b-bb61-8d8ae11edb35 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:18.214691 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2653e9e3-1e2f-482b-bb61-8d8ae11edb35 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:18.215400 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2653e9e3-1e2f-482b-bb61-8d8ae11edb35 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:18.215882 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2653e9e3-1e2f-482b-bb61-8d8ae11edb35 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:18.216312 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2653e9e3-1e2f-482b-bb61-8d8ae11edb35 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:18.248156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-2653e9e3-1e2f-482b-bb61-8d8ae11edb35 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lazy-loading 'flavor' on Instance uuid f6298d28-8cba-46d8-a809-bd0f81e18d58 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:07:18.821147 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8e199d59-ed91-4f41-8fe5-b91a2abecb4f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:18.821665 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-8e199d59-ed91-4f41-8fe5-b91a2abecb4f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:18.834575 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8e199d59-ed91-4f41-8fe5-b91a2abecb4f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:18.835265 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8e199d59-ed91-4f41-8fe5-b91a2abecb4f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:18.836126 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8e199d59-ed91-4f41-8fe5-b91a2abecb4f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:18.837008 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8e199d59-ed91-4f41-8fe5-b91a2abecb4f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:18.837968 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8e199d59-ed91-4f41-8fe5-b91a2abecb4f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:18.838587 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8e199d59-ed91-4f41-8fe5-b91a2abecb4f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:18.873670 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-8e199d59-ed91-4f41-8fe5-b91a2abecb4f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8/ips" status: 200 len: 149 microversion: 2.1 time: 0.057354 Sep 26 18:07:18.881656 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 212/429] 10.222.0.67 () {58 vars in 1248 bytes} [Mon Sep 26 18:07:18 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8/ips => generated 149 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:07:18.888963 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b586a2e0-a7fa-454f-b81b-6e9844099a08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd2b3474-c448-4c7b-b7c1-1bc76ea0a413"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:07:18.892927 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b586a2e0-a7fa-454f-b81b-6e9844099a08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:18.900733 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b586a2e0-a7fa-454f-b81b-6e9844099a08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:18.901231 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b586a2e0-a7fa-454f-b81b-6e9844099a08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:18.901662 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b586a2e0-a7fa-454f-b81b-6e9844099a08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:18.902426 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b586a2e0-a7fa-454f-b81b-6e9844099a08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:18.902996 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b586a2e0-a7fa-454f-b81b-6e9844099a08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:18.903419 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b586a2e0-a7fa-454f-b81b-6e9844099a08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:19.072891 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-b586a2e0-a7fa-454f-b81b-6e9844099a08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] HTTP exception thrown: Invalid volume: volume cd2b3474-c448-4c7b-b7c1-1bc76ea0a413 is already attached to instances: 9682673d-b9ac-49a7-9f72-eef56dcbac73 Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b586a2e0-a7fa-454f-b81b-6e9844099a08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Request method failure captured: Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: POST /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8/os-volume_attachments HTTP/1.1 Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 74 Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMelsNex1FlD2CBY8G-ysnjsye_l-7KQaYKxzjq-uqqw_c6lt3XOkxaeXEOSBPxdrGfGNF6J_jwjGWJdIRzcPmWbMtwg-2UVrF8ghY8jl9NOGZb0sL_3XrXpF2FeqtmN-NjzE_b12zyopUCDg2jN5eXXFmLWv81UC7SHabJvYKq1cYR8 Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:07:19.074742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:07:19.076177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:07:19.076177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:07:19.076177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:07:19.076177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:07:19.076177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:07:19.076177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:07:19.076177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:07:19.076177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 0bede3a601f941e7abc9fd16983679b2 Sep 26 18:07:19.076177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:07:19.076177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Sep 26 18:07:19.076177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {"volumeAttachment": {"volumeId": "cd2b3474-c448-4c7b-b7c1-1bc76ea0a413"}} Sep 26 18:07:19.076177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Invalid volume: volume cd2b3474-c448-4c7b-b7c1-1bc76ea0a413 is already attached to instances: 9682673d-b9ac-49a7-9f72-eef56dcbac73 Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'server_id': '4a3d0414-434f-4d77-8bc1-57378672d4f8', 'body': {'volumeAttachment': {'volumeId': 'cd2b3474-c448-4c7b-b7c1-1bc76ea0a413'}}} Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cd2b3474-c448-4c7b-b7c1-1bc76ea0a413 is already attached to instances: 9682673d-b9ac-49a7-9f72-eef56dcbac73 Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:07:19.076925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cd2b3474-c448-4c7b-b7c1-1bc76ea0a413 is already attached to instances: 9682673d-b9ac-49a7-9f72-eef56dcbac73 Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:07:19.079482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:07:19.080850 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:07:19.080850 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:07:19.080850 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:07:19.080850 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cd2b3474-c448-4c7b-b7c1-1bc76ea0a413 is already attached to instances: 9682673d-b9ac-49a7-9f72-eef56dcbac73 Sep 26 18:07:19.080850 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:07:19.080850 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b586a2e0-a7fa-454f-b81b-6e9844099a08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Returning 400 to user: Invalid volume: volume cd2b3474-c448-4c7b-b7c1-1bc76ea0a413 is already attached to instances: 9682673d-b9ac-49a7-9f72-eef56dcbac73 {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:07:19.080850 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b586a2e0-a7fa-454f-b81b-6e9844099a08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "POST /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.193106 Sep 26 18:07:19.080850 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 213/430] 10.222.0.67 () {60 vars in 1323 bytes} [Mon Sep 26 18:07:18 2022] POST /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8/os-volume_attachments => generated 174 bytes in 195 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 26 18:07:19.090417 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1f0de3ea-3c64-4c5d-bc76-7e3ac5bd9701 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:19.090929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1f0de3ea-3c64-4c5d-bc76-7e3ac5bd9701 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:19.102372 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f0de3ea-3c64-4c5d-bc76-7e3ac5bd9701 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:19.102372 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f0de3ea-3c64-4c5d-bc76-7e3ac5bd9701 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:19.102372 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f0de3ea-3c64-4c5d-bc76-7e3ac5bd9701 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:19.102372 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f0de3ea-3c64-4c5d-bc76-7e3ac5bd9701 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:19.103310 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f0de3ea-3c64-4c5d-bc76-7e3ac5bd9701 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:19.103310 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f0de3ea-3c64-4c5d-bc76-7e3ac5bd9701 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:19.160167 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1f0de3ea-3c64-4c5d-bc76-7e3ac5bd9701 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Going to try to terminate instance {{(pid=121029) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:07:19.680107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1f0de3ea-3c64-4c5d-bc76-7e3ac5bd9701 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 204 len: 0 microversion: 2.1 time: 0.595987 Sep 26 18:07:19.680900 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 214/431] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:07:19 2022] DELETE /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:07:19.686546 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2050352355", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1527584654", "security_groups": [{"name": "tempest-secgroup-smoke-1116016539"}], "networks": [{"uuid": "a36a0132-e2f2-42fb-aeb7-7b514a623f8b"}], "block_device_mapping_v2": [{"uuid": "7b752162-7209-41a9-8068-3ba4eedd3eb1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:07:19.877943 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.network.neutron [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] validate_networks() for [('a36a0132-e2f2-42fb-aeb7-7b514a623f8b', None, None, None, None, None)] {{(pid=121029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:07:20.413532 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Flavor limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:07:20.414024 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Image limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:07:20.414629 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Flavor pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:07:20.415109 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Image pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:07:20.415680 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:07:20.426091 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:20.426575 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:20.427004 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:20.427755 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:20.428206 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:20.428621 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:20.450879 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Getting quotas for project 08e4bf78b8f043a598a4b6a1d8acc219. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:07:20.457174 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Getting quotas for user 183fe84502664f49a701a5e9eb4f6cd7 and project 08e4bf78b8f043a598a4b6a1d8acc219. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:07:20.539675 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Going to run 1 instances... {{(pid=121029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:07:20.542538 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b752162-7209-41a9-8068-3ba4eedd3eb1',volume_size=None,volume_type=None)] {{(pid=121029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:07:21.079159 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e299994e-e2d5-40c4-8ad9-6c6709239b8f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.396861 Sep 26 18:07:21.087095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 215/432] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:07:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:07:21.087095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-692048b8-3102-4cde-9993-bd398cd2cb8e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:21.087095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-692048b8-3102-4cde-9993-bd398cd2cb8e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:21.097571 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-692048b8-3102-4cde-9993-bd398cd2cb8e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:21.101452 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-692048b8-3102-4cde-9993-bd398cd2cb8e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:21.101452 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-692048b8-3102-4cde-9993-bd398cd2cb8e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:21.101452 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-692048b8-3102-4cde-9993-bd398cd2cb8e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:21.101452 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-692048b8-3102-4cde-9993-bd398cd2cb8e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:21.102128 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-692048b8-3102-4cde-9993-bd398cd2cb8e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:21.310358 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-692048b8-3102-4cde-9993-bd398cd2cb8e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:21.326724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-692048b8-3102-4cde-9993-bd398cd2cb8e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1681 microversion: 2.1 time: 0.245787 Sep 26 18:07:21.327470 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 216/433] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:21 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1681 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:21.337209 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5d9e6bca-ce43-4651-b4f3-3c95800a9aaf tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:21.337801 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-5d9e6bca-ce43-4651-b4f3-3c95800a9aaf tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:21.414410 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5d9e6bca-ce43-4651-b4f3-3c95800a9aaf tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:21.423809 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5d9e6bca-ce43-4651-b4f3-3c95800a9aaf tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1089 microversion: 2.1 time: 0.094471 Sep 26 18:07:21.424672 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 217/434] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:21 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1089 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:22.368443 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d07b05c3-c052-4dd3-a5cb-90a5ab80dba1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:22.370297 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d07b05c3-c052-4dd3-a5cb-90a5ab80dba1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:22.386266 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d07b05c3-c052-4dd3-a5cb-90a5ab80dba1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:22.387862 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d07b05c3-c052-4dd3-a5cb-90a5ab80dba1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:22.389262 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d07b05c3-c052-4dd3-a5cb-90a5ab80dba1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:22.391522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d07b05c3-c052-4dd3-a5cb-90a5ab80dba1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:22.393438 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d07b05c3-c052-4dd3-a5cb-90a5ab80dba1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:22.394077 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d07b05c3-c052-4dd3-a5cb-90a5ab80dba1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:22.701483 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d07b05c3-c052-4dd3-a5cb-90a5ab80dba1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:22.715238 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d07b05c3-c052-4dd3-a5cb-90a5ab80dba1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1681 microversion: 2.1 time: 0.356196 Sep 26 18:07:22.716714 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 218/435] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:22 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1681 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:22.722563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b084a931-c6cc-4dfa-a087-9530f55ca4f0 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:22.723291 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b084a931-c6cc-4dfa-a087-9530f55ca4f0 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:22.736992 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b084a931-c6cc-4dfa-a087-9530f55ca4f0 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:22.738170 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b084a931-c6cc-4dfa-a087-9530f55ca4f0 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:22.739128 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b084a931-c6cc-4dfa-a087-9530f55ca4f0 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:22.740459 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b084a931-c6cc-4dfa-a087-9530f55ca4f0 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:22.741401 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b084a931-c6cc-4dfa-a087-9530f55ca4f0 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:22.742162 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b084a931-c6cc-4dfa-a087-9530f55ca4f0 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:22.872080 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b084a931-c6cc-4dfa-a087-9530f55ca4f0 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:22.882896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b084a931-c6cc-4dfa-a087-9530f55ca4f0 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1139 microversion: 2.1 time: 0.165170 Sep 26 18:07:22.883497 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 219/436] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:22 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1139 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:23.752867 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bde8aecf-f30a-4890-ada1-f878881104b8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:23.754445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-bde8aecf-f30a-4890-ada1-f878881104b8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:23.774253 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bde8aecf-f30a-4890-ada1-f878881104b8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:23.775738 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bde8aecf-f30a-4890-ada1-f878881104b8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:23.776291 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bde8aecf-f30a-4890-ada1-f878881104b8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:23.777282 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bde8aecf-f30a-4890-ada1-f878881104b8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:23.779583 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bde8aecf-f30a-4890-ada1-f878881104b8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:23.780488 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bde8aecf-f30a-4890-ada1-f878881104b8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:23.961430 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bde8aecf-f30a-4890-ada1-f878881104b8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:23.986967 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bde8aecf-f30a-4890-ada1-f878881104b8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1614 microversion: 2.1 time: 0.242212 Sep 26 18:07:24.009480 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 220/437] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:23 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1614 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:24.039219 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-85a16662-ccd4-4988-9aff-0700f5e3158a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:24.040269 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-85a16662-ccd4-4988-9aff-0700f5e3158a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:24.054685 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85a16662-ccd4-4988-9aff-0700f5e3158a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:24.055436 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85a16662-ccd4-4988-9aff-0700f5e3158a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:24.055823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85a16662-ccd4-4988-9aff-0700f5e3158a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:24.057030 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85a16662-ccd4-4988-9aff-0700f5e3158a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:24.058088 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85a16662-ccd4-4988-9aff-0700f5e3158a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:24.058969 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85a16662-ccd4-4988-9aff-0700f5e3158a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:24.205639 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-85a16662-ccd4-4988-9aff-0700f5e3158a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:24.223165 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-85a16662-ccd4-4988-9aff-0700f5e3158a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1187 microversion: 2.1 time: 0.203110 Sep 26 18:07:24.223901 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 221/438] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:24 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1187 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:24.457761 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-460f974d-2bc9-484b-b9ec-18a5218dde17 req-498286c2-e9b4-49f5-a48f-8d22c46e7739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a3d0414-434f-4d77-8bc1-57378672d4f8", "name": "network-vif-deleted", "tag": "4db13c14-6478-4992-8d31-4a46754d492e"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:07:24.476313 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-460f974d-2bc9-484b-b9ec-18a5218dde17 req-498286c2-e9b4-49f5-a48f-8d22c46e7739 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:24.478174 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-460f974d-2bc9-484b-b9ec-18a5218dde17 req-498286c2-e9b4-49f5-a48f-8d22c46e7739 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:24.479964 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-460f974d-2bc9-484b-b9ec-18a5218dde17 req-498286c2-e9b4-49f5-a48f-8d22c46e7739 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:24.498010 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-460f974d-2bc9-484b-b9ec-18a5218dde17 req-498286c2-e9b4-49f5-a48f-8d22c46e7739 service nova] Creating event network-vif-deleted:4db13c14-6478-4992-8d31-4a46754d492e for instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 on hv-cinder-85931 Sep 26 18:07:24.506800 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-460f974d-2bc9-484b-b9ec-18a5218dde17 req-498286c2-e9b4-49f5-a48f-8d22c46e7739 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053891 Sep 26 18:07:24.507572 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 222/439] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:07:25.018251 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-4d55c53a-6def-410b-81c3-2f032529d4e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:25.029376 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-4d55c53a-6def-410b-81c3-2f032529d4e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:25.029376 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4d55c53a-6def-410b-81c3-2f032529d4e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:25.029376 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4d55c53a-6def-410b-81c3-2f032529d4e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:25.029376 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4d55c53a-6def-410b-81c3-2f032529d4e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:25.029808 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4d55c53a-6def-410b-81c3-2f032529d4e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:25.029808 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4d55c53a-6def-410b-81c3-2f032529d4e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:25.029808 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4d55c53a-6def-410b-81c3-2f032529d4e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:25.079179 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4d55c53a-6def-410b-81c3-2f032529d4e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:25.079862 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4d55c53a-6def-410b-81c3-2f032529d4e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:25.080309 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4d55c53a-6def-410b-81c3-2f032529d4e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:25.080977 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-4d55c53a-6def-410b-81c3-2f032529d4e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lazy-loading 'fault' on Instance uuid 4a3d0414-434f-4d77-8bc1-57378672d4f8 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:07:25.209884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-4d55c53a-6def-410b-81c3-2f032529d4e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:25.243087 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-4d55c53a-6def-410b-81c3-2f032529d4e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1332 microversion: 2.1 time: 0.224996 Sep 26 18:07:25.245561 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 223/440] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:25 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1332 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:07:25.260430 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1f76fc7f-099e-4050-a773-ae6e3c0095bf tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:25.261054 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1f76fc7f-099e-4050-a773-ae6e3c0095bf tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:25.275287 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f76fc7f-099e-4050-a773-ae6e3c0095bf tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:25.275829 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f76fc7f-099e-4050-a773-ae6e3c0095bf tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:25.278706 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f76fc7f-099e-4050-a773-ae6e3c0095bf tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:25.283143 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f76fc7f-099e-4050-a773-ae6e3c0095bf tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:25.283709 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f76fc7f-099e-4050-a773-ae6e3c0095bf tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:25.284238 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f76fc7f-099e-4050-a773-ae6e3c0095bf tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:25.505390 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1f76fc7f-099e-4050-a773-ae6e3c0095bf tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:25.548794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1f76fc7f-099e-4050-a773-ae6e3c0095bf tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1205 microversion: 2.1 time: 0.300775 Sep 26 18:07:25.551395 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 224/441] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:25 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1205 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:26.301427 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-13883ffd-de9f-4693-b939-e0675f57e220 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:26.306255 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-13883ffd-de9f-4693-b939-e0675f57e220 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:26.379291 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-13883ffd-de9f-4693-b939-e0675f57e220 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:26.382089 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-13883ffd-de9f-4693-b939-e0675f57e220 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:26.389066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-13883ffd-de9f-4693-b939-e0675f57e220 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:26.391304 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-13883ffd-de9f-4693-b939-e0675f57e220 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:26.394370 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-13883ffd-de9f-4693-b939-e0675f57e220 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:26.398338 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-13883ffd-de9f-4693-b939-e0675f57e220 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:26.643626 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-13883ffd-de9f-4693-b939-e0675f57e220 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:26.662671 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-13883ffd-de9f-4693-b939-e0675f57e220 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:26.663752 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-13883ffd-de9f-4693-b939-e0675f57e220 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:26.664723 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-13883ffd-de9f-4693-b939-e0675f57e220 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lazy-loading 'fault' on Instance uuid 4a3d0414-434f-4d77-8bc1-57378672d4f8 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:07:26.798052 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-13883ffd-de9f-4693-b939-e0675f57e220 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:26.831466 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-13883ffd-de9f-4693-b939-e0675f57e220 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 200 len: 1332 microversion: 2.1 time: 0.553690 Sep 26 18:07:26.839922 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 225/442] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:26 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 1332 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:26.878778 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-cb5fd62a-cef2-4fd6-8913-ed5c901f6771 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:26.884906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-cb5fd62a-cef2-4fd6-8913-ed5c901f6771 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:26.924932 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb5fd62a-cef2-4fd6-8913-ed5c901f6771 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:26.927915 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb5fd62a-cef2-4fd6-8913-ed5c901f6771 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:26.931786 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb5fd62a-cef2-4fd6-8913-ed5c901f6771 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:26.936485 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb5fd62a-cef2-4fd6-8913-ed5c901f6771 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:26.939146 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb5fd62a-cef2-4fd6-8913-ed5c901f6771 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:26.941649 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb5fd62a-cef2-4fd6-8913-ed5c901f6771 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:27.284869 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-cb5fd62a-cef2-4fd6-8913-ed5c901f6771 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:27.294043 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-cb5fd62a-cef2-4fd6-8913-ed5c901f6771 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1273 microversion: 2.1 time: 0.433425 Sep 26 18:07:27.294632 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 226/443] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:26 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1273 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:27.768691 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2653e9e3-1e2f-482b-bb61-8d8ae11edb35 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "POST /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/action" status: 202 len: 0 microversion: 2.20 time: 9.570635 Sep 26 18:07:27.771495 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 218/444] 10.222.0.67 () {62 vars in 1319 bytes} [Mon Sep 26 18:07:18 2022] POST /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/action => generated 0 bytes in 9575 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:07:27.778145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9e4bb7bb-6b85-4c87-98de-b3b7d5466eb9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:27.779854 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9e4bb7bb-6b85-4c87-98de-b3b7d5466eb9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:27.787748 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9e4bb7bb-6b85-4c87-98de-b3b7d5466eb9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:27.788242 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9e4bb7bb-6b85-4c87-98de-b3b7d5466eb9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:27.788679 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9e4bb7bb-6b85-4c87-98de-b3b7d5466eb9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:27.789395 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9e4bb7bb-6b85-4c87-98de-b3b7d5466eb9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:27.789849 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9e4bb7bb-6b85-4c87-98de-b3b7d5466eb9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:27.790270 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9e4bb7bb-6b85-4c87-98de-b3b7d5466eb9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:27.875270 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-5e14ab13-d96b-4026-91f3-535a13e15032 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:27.876121 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-5e14ab13-d96b-4026-91f3-535a13e15032 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:27.885052 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e14ab13-d96b-4026-91f3-535a13e15032 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:27.885739 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e14ab13-d96b-4026-91f3-535a13e15032 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:27.886414 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e14ab13-d96b-4026-91f3-535a13e15032 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:27.887957 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e14ab13-d96b-4026-91f3-535a13e15032 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:27.888653 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e14ab13-d96b-4026-91f3-535a13e15032 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:27.889345 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e14ab13-d96b-4026-91f3-535a13e15032 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:27.916269 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-5e14ab13-d96b-4026-91f3-535a13e15032 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] HTTP exception thrown: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-5e14ab13-d96b-4026-91f3-535a13e15032 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Request method failure captured: Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 HTTP/1.1 Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMelsNex1FlD2CBY8G-ysnjsye_l-7KQaYKxzjq-uqqw_c6lt3XOkxaeXEOSBPxdrGfGNF6J_jwjGWJdIRzcPmWbMtwg-2UVrF8ghY8jl9NOGZb0sL_3XrXpF2FeqtmN-NjzE_b12zyopUCDg2jN5eXXFmLWv81UC7SHabJvYKq1cYR8 Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:07:27.917868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:07:27.919294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:07:27.919294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:07:27.919294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:07:27.919294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:07:27.919294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:07:27.919294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:07:27.919294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:07:27.919294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 0bede3a601f941e7abc9fd16983679b2 Sep 26 18:07:27.919294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:07:27.919294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:07:27.919294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. Sep 26 18:07:27.919294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '4a3d0414-434f-4d77-8bc1-57378672d4f8'} Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:07:27.920198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. Sep 26 18:07:27.921894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:07:27.923186 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-5e14ab13-d96b-4026-91f3-535a13e15032 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Returning 404 to user: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:07:27.923186 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-5e14ab13-d96b-4026-91f3-535a13e15032 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 404 len: 111 microversion: 2.1 time: 0.049522 Sep 26 18:07:27.923186 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 219/445] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:27 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:07:27.932800 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-96ca80c8-511a-489c-af5f-00d60c3b3f81 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '.version_select at 0x7f3a74b039d0>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:27.964983 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9e4bb7bb-6b85-4c87-98de-b3b7d5466eb9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:27.974601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9e4bb7bb-6b85-4c87-98de-b3b7d5466eb9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:27.976550 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9e4bb7bb-6b85-4c87-98de-b3b7d5466eb9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:27.977748 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9e4bb7bb-6b85-4c87-98de-b3b7d5466eb9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.203974 Sep 26 18:07:27.978519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 227/446] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:27 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:07:27.984310 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-a979b6cb-ba84-4249-8956-98be59dbb9ec req-c1dbb387-34ed-4422-85ff-103668de06f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19e1622-6521-459d-9db1-80abd4bcf0f8", "tag": "df9e6e2c-d105-4f6a-aaf7-3619c1f5c26c"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:07:27.996239 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-a979b6cb-ba84-4249-8956-98be59dbb9ec req-c1dbb387-34ed-4422-85ff-103668de06f8 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:27.996723 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-a979b6cb-ba84-4249-8956-98be59dbb9ec req-c1dbb387-34ed-4422-85ff-103668de06f8 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:27.997366 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-a979b6cb-ba84-4249-8956-98be59dbb9ec req-c1dbb387-34ed-4422-85ff-103668de06f8 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:28.002371 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:28.009663 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-a979b6cb-ba84-4249-8956-98be59dbb9ec req-c1dbb387-34ed-4422-85ff-103668de06f8 service nova] Creating event network-changed:df9e6e2c-d105-4f6a-aaf7-3619c1f5c26c for instance b19e1622-6521-459d-9db1-80abd4bcf0f8 on hv-cinder-85931 Sep 26 18:07:28.014640 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-a979b6cb-ba84-4249-8956-98be59dbb9ec req-c1dbb387-34ed-4422-85ff-103668de06f8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035010 Sep 26 18:07:28.015306 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 228/447] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:07:28.091977 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-96ca80c8-511a-489c-af5f-00d60c3b3f81 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1095959337" status: 202 len: 0 microversion: 2.1 time: 0.163699 Sep 26 18:07:28.093022 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 220/448] 10.222.0.67 () {58 vars in 1221 bytes} [Mon Sep 26 18:07:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1095959337 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:07:28.322324 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-48bb0ac8-7856-4c46-8488-bc2c1eb3e112 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:28.323220 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-48bb0ac8-7856-4c46-8488-bc2c1eb3e112 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:28.330971 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-48bb0ac8-7856-4c46-8488-bc2c1eb3e112 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:28.331600 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-48bb0ac8-7856-4c46-8488-bc2c1eb3e112 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:28.332085 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-48bb0ac8-7856-4c46-8488-bc2c1eb3e112 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:28.333359 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-48bb0ac8-7856-4c46-8488-bc2c1eb3e112 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:28.333359 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-48bb0ac8-7856-4c46-8488-bc2c1eb3e112 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:28.333714 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-48bb0ac8-7856-4c46-8488-bc2c1eb3e112 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:28.577202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-48bb0ac8-7856-4c46-8488-bc2c1eb3e112 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:28.586419 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-48bb0ac8-7856-4c46-8488-bc2c1eb3e112 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1261 microversion: 2.1 time: 0.268270 Sep 26 18:07:28.587260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 229/449] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:28 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1261 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:29.012634 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6d7b1e96-a7c4-40a3-8c07-5418903dc2a5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:29.014156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-6d7b1e96-a7c4-40a3-8c07-5418903dc2a5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:29.026520 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d7b1e96-a7c4-40a3-8c07-5418903dc2a5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:29.027803 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d7b1e96-a7c4-40a3-8c07-5418903dc2a5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:29.028732 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d7b1e96-a7c4-40a3-8c07-5418903dc2a5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:29.030086 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d7b1e96-a7c4-40a3-8c07-5418903dc2a5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:29.031598 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d7b1e96-a7c4-40a3-8c07-5418903dc2a5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:29.032421 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d7b1e96-a7c4-40a3-8c07-5418903dc2a5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:29.149356 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-00a09cbf-1d43-4b9e-aa25-ef787764db85 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:29.149889 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-00a09cbf-1d43-4b9e-aa25-ef787764db85 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:29.157693 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00a09cbf-1d43-4b9e-aa25-ef787764db85 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:29.158612 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00a09cbf-1d43-4b9e-aa25-ef787764db85 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:29.159069 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00a09cbf-1d43-4b9e-aa25-ef787764db85 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:29.159813 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00a09cbf-1d43-4b9e-aa25-ef787764db85 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:29.160277 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00a09cbf-1d43-4b9e-aa25-ef787764db85 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:29.160802 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00a09cbf-1d43-4b9e-aa25-ef787764db85 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:29.202146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6d7b1e96-a7c4-40a3-8c07-5418903dc2a5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:29.211557 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6d7b1e96-a7c4-40a3-8c07-5418903dc2a5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:29.213377 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6d7b1e96-a7c4-40a3-8c07-5418903dc2a5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:29.214230 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-6d7b1e96-a7c4-40a3-8c07-5418903dc2a5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.211265 Sep 26 18:07:29.214779 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 221/450] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:29 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:07:29.303232 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-00a09cbf-1d43-4b9e-aa25-ef787764db85 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lazy-loading 'services' on Instance uuid 9682673d-b9ac-49a7-9f72-eef56dcbac73 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:07:29.610339 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-215f0c56-db0a-40b3-93d0-b67ad90bab67 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:29.611175 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-215f0c56-db0a-40b3-93d0-b67ad90bab67 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:29.617633 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-215f0c56-db0a-40b3-93d0-b67ad90bab67 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:29.618189 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-215f0c56-db0a-40b3-93d0-b67ad90bab67 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:29.618665 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-215f0c56-db0a-40b3-93d0-b67ad90bab67 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:29.619339 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-215f0c56-db0a-40b3-93d0-b67ad90bab67 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:29.619832 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-215f0c56-db0a-40b3-93d0-b67ad90bab67 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:29.620268 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-215f0c56-db0a-40b3-93d0-b67ad90bab67 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:29.653130 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-00a09cbf-1d43-4b9e-aa25-ef787764db85 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73/os-volume_attachments/cd2b3474-c448-4c7b-b7c1-1bc76ea0a413" status: 202 len: 0 microversion: 2.1 time: 0.511113 Sep 26 18:07:29.653736 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 230/451] 10.222.0.67 () {58 vars in 1416 bytes} [Mon Sep 26 18:07:29 2022] DELETE /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73/os-volume_attachments/cd2b3474-c448-4c7b-b7c1-1bc76ea0a413 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:07:29.662739 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-4e8bd863-333d-4a11-8ba1-3b1ec4cf4c47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:29.665123 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-4e8bd863-333d-4a11-8ba1-3b1ec4cf4c47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:29.672250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4e8bd863-333d-4a11-8ba1-3b1ec4cf4c47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:29.674245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4e8bd863-333d-4a11-8ba1-3b1ec4cf4c47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:29.674245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4e8bd863-333d-4a11-8ba1-3b1ec4cf4c47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:29.674245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4e8bd863-333d-4a11-8ba1-3b1ec4cf4c47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:29.674516 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4e8bd863-333d-4a11-8ba1-3b1ec4cf4c47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:29.675141 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4e8bd863-333d-4a11-8ba1-3b1ec4cf4c47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:29.718436 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-4e8bd863-333d-4a11-8ba1-3b1ec4cf4c47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059682 Sep 26 18:07:29.724912 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 231/452] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:07:29 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:07:29.883626 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-215f0c56-db0a-40b3-93d0-b67ad90bab67 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:29.893716 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-215f0c56-db0a-40b3-93d0-b67ad90bab67 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1261 microversion: 2.1 time: 0.287285 Sep 26 18:07:29.899515 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 222/453] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:29 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1261 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:07:30.242632 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e52e3d87-119e-4de8-93de-8efe5a5e9a52 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:30.243176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e52e3d87-119e-4de8-93de-8efe5a5e9a52 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:30.250749 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e52e3d87-119e-4de8-93de-8efe5a5e9a52 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:30.251257 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e52e3d87-119e-4de8-93de-8efe5a5e9a52 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:30.251709 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e52e3d87-119e-4de8-93de-8efe5a5e9a52 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:30.252543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e52e3d87-119e-4de8-93de-8efe5a5e9a52 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:30.253004 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e52e3d87-119e-4de8-93de-8efe5a5e9a52 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:30.253442 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e52e3d87-119e-4de8-93de-8efe5a5e9a52 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:30.394652 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e52e3d87-119e-4de8-93de-8efe5a5e9a52 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:30.404500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e52e3d87-119e-4de8-93de-8efe5a5e9a52 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:30.406546 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e52e3d87-119e-4de8-93de-8efe5a5e9a52 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:30.408104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e52e3d87-119e-4de8-93de-8efe5a5e9a52 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.169669 Sep 26 18:07:30.408761 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 232/454] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:30 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:07:30.732838 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c0c6192c-34dc-4244-8676-44a3e81c594c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:30.735111 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c0c6192c-34dc-4244-8676-44a3e81c594c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:30.741630 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c0c6192c-34dc-4244-8676-44a3e81c594c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:30.742112 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c0c6192c-34dc-4244-8676-44a3e81c594c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:30.742548 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c0c6192c-34dc-4244-8676-44a3e81c594c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:30.743238 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c0c6192c-34dc-4244-8676-44a3e81c594c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:30.743745 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c0c6192c-34dc-4244-8676-44a3e81c594c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:30.744171 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c0c6192c-34dc-4244-8676-44a3e81c594c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:30.782189 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c0c6192c-34dc-4244-8676-44a3e81c594c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053163 Sep 26 18:07:30.782648 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 223/455] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:07:30 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:07:30.920349 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d1083b9b-b82e-44a8-a054-816769b3983e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:30.920950 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d1083b9b-b82e-44a8-a054-816769b3983e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:30.923219 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:30.928806 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d1083b9b-b82e-44a8-a054-816769b3983e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:30.929294 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d1083b9b-b82e-44a8-a054-816769b3983e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:30.929728 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d1083b9b-b82e-44a8-a054-816769b3983e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:30.930418 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d1083b9b-b82e-44a8-a054-816769b3983e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:30.930871 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d1083b9b-b82e-44a8-a054-816769b3983e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:30.931293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d1083b9b-b82e-44a8-a054-816769b3983e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:31.096953 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d1083b9b-b82e-44a8-a054-816769b3983e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:31.110728 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d1083b9b-b82e-44a8-a054-816769b3983e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1261 microversion: 2.1 time: 0.194132 Sep 26 18:07:31.111304 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 233/456] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:30 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1261 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:07:31.437219 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-bd1410c6-0926-4304-9e23-a81697317127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:31.438190 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-bd1410c6-0926-4304-9e23-a81697317127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:31.444378 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd1410c6-0926-4304-9e23-a81697317127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:31.444870 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd1410c6-0926-4304-9e23-a81697317127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:31.445337 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd1410c6-0926-4304-9e23-a81697317127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:31.446074 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd1410c6-0926-4304-9e23-a81697317127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:31.446528 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd1410c6-0926-4304-9e23-a81697317127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:31.446943 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd1410c6-0926-4304-9e23-a81697317127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:31.605169 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-bd1410c6-0926-4304-9e23-a81697317127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:31.616846 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-bd1410c6-0926-4304-9e23-a81697317127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:31.618948 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-bd1410c6-0926-4304-9e23-a81697317127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:31.621223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-bd1410c6-0926-4304-9e23-a81697317127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.188018 Sep 26 18:07:31.621969 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 224/457] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:31 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:07:31.797283 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9ab909fc-7c40-4964-81a2-7b783cc19415 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:31.799934 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9ab909fc-7c40-4964-81a2-7b783cc19415 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:31.802397 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=8 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:31.807596 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9ab909fc-7c40-4964-81a2-7b783cc19415 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:31.808164 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9ab909fc-7c40-4964-81a2-7b783cc19415 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:31.808600 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9ab909fc-7c40-4964-81a2-7b783cc19415 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:31.809305 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9ab909fc-7c40-4964-81a2-7b783cc19415 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:31.809791 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9ab909fc-7c40-4964-81a2-7b783cc19415 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:31.810223 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9ab909fc-7c40-4964-81a2-7b783cc19415 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:31.843028 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9ab909fc-7c40-4964-81a2-7b783cc19415 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051851 Sep 26 18:07:31.845590 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 234/458] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:07:31 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 18:07:31.915290 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-57359e6d-1f29-4d21-ac92-1abaffe5d065 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:31.916070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-57359e6d-1f29-4d21-ac92-1abaffe5d065 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:31.923023 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-57359e6d-1f29-4d21-ac92-1abaffe5d065 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:31.923507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-57359e6d-1f29-4d21-ac92-1abaffe5d065 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:31.924022 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-57359e6d-1f29-4d21-ac92-1abaffe5d065 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:31.925072 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-57359e6d-1f29-4d21-ac92-1abaffe5d065 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:31.925535 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-57359e6d-1f29-4d21-ac92-1abaffe5d065 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:31.925952 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-57359e6d-1f29-4d21-ac92-1abaffe5d065 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:31.963007 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-57359e6d-1f29-4d21-ac92-1abaffe5d065 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Going to try to terminate instance {{(pid=121028) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:07:32.139993 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c25fa6e7-9db7-4597-b105-8ee38a717e7d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:32.142065 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c25fa6e7-9db7-4597-b105-8ee38a717e7d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:32.149987 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c25fa6e7-9db7-4597-b105-8ee38a717e7d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:32.150522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c25fa6e7-9db7-4597-b105-8ee38a717e7d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:32.151003 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c25fa6e7-9db7-4597-b105-8ee38a717e7d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:32.151756 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c25fa6e7-9db7-4597-b105-8ee38a717e7d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:32.152221 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c25fa6e7-9db7-4597-b105-8ee38a717e7d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:32.152642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c25fa6e7-9db7-4597-b105-8ee38a717e7d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:32.311155 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-57359e6d-1f29-4d21-ac92-1abaffe5d065 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 204 len: 0 microversion: 2.1 time: 0.401077 Sep 26 18:07:32.314530 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 225/459] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:07:31 2022] DELETE /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:07:32.321776 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-13ac26cb-3999-49da-9c9e-b7899530ecc5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:32.322494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-13ac26cb-3999-49da-9c9e-b7899530ecc5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:32.329502 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-13ac26cb-3999-49da-9c9e-b7899530ecc5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:32.330228 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-13ac26cb-3999-49da-9c9e-b7899530ecc5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:32.330673 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-13ac26cb-3999-49da-9c9e-b7899530ecc5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:32.331387 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-13ac26cb-3999-49da-9c9e-b7899530ecc5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:32.331958 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-13ac26cb-3999-49da-9c9e-b7899530ecc5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:32.332475 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-13ac26cb-3999-49da-9c9e-b7899530ecc5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:32.352951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c25fa6e7-9db7-4597-b105-8ee38a717e7d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:32.361467 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c25fa6e7-9db7-4597-b105-8ee38a717e7d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1261 microversion: 2.1 time: 0.228225 Sep 26 18:07:32.362045 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 235/460] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:32 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1261 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:07:32.514934 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-13ac26cb-3999-49da-9c9e-b7899530ecc5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:32.525060 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-13ac26cb-3999-49da-9c9e-b7899530ecc5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1680 microversion: 2.1 time: 0.207414 Sep 26 18:07:32.525994 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 226/461] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:32 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:07:32.655606 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9be0dbee-3ebf-4a4d-8c8c-bc28faad57a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:32.657039 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9be0dbee-3ebf-4a4d-8c8c-bc28faad57a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:32.663101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9be0dbee-3ebf-4a4d-8c8c-bc28faad57a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:32.663591 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9be0dbee-3ebf-4a4d-8c8c-bc28faad57a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:32.668617 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9be0dbee-3ebf-4a4d-8c8c-bc28faad57a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:32.668617 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9be0dbee-3ebf-4a4d-8c8c-bc28faad57a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:32.668617 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9be0dbee-3ebf-4a4d-8c8c-bc28faad57a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:32.668617 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9be0dbee-3ebf-4a4d-8c8c-bc28faad57a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:32.804743 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9be0dbee-3ebf-4a4d-8c8c-bc28faad57a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:32.816375 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9be0dbee-3ebf-4a4d-8c8c-bc28faad57a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:32.817866 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9be0dbee-3ebf-4a4d-8c8c-bc28faad57a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:32.819033 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9be0dbee-3ebf-4a4d-8c8c-bc28faad57a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.167268 Sep 26 18:07:32.819592 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 236/462] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:32 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:07:33.398022 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a3319a21-96c3-412e-8ceb-e4d74ece7134 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:33.398889 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a3319a21-96c3-412e-8ceb-e4d74ece7134 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:33.406533 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a3319a21-96c3-412e-8ceb-e4d74ece7134 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:33.410940 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a3319a21-96c3-412e-8ceb-e4d74ece7134 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:33.410940 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a3319a21-96c3-412e-8ceb-e4d74ece7134 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:33.410940 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a3319a21-96c3-412e-8ceb-e4d74ece7134 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:33.410940 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a3319a21-96c3-412e-8ceb-e4d74ece7134 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:33.413356 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a3319a21-96c3-412e-8ceb-e4d74ece7134 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:33.549765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a3319a21-96c3-412e-8ceb-e4d74ece7134 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:33.552768 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-284d5871-1016-4a35-847b-6fafba6123d8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:33.553396 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-284d5871-1016-4a35-847b-6fafba6123d8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:33.557956 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a3319a21-96c3-412e-8ceb-e4d74ece7134 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1261 microversion: 2.1 time: 0.163792 Sep 26 18:07:33.558562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 227/463] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:33 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:07:33.559358 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-284d5871-1016-4a35-847b-6fafba6123d8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:33.559918 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-284d5871-1016-4a35-847b-6fafba6123d8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:33.560364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-284d5871-1016-4a35-847b-6fafba6123d8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:33.561108 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-284d5871-1016-4a35-847b-6fafba6123d8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:33.561578 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-284d5871-1016-4a35-847b-6fafba6123d8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:33.562006 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-284d5871-1016-4a35-847b-6fafba6123d8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:33.728771 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-284d5871-1016-4a35-847b-6fafba6123d8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:33.740399 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-284d5871-1016-4a35-847b-6fafba6123d8 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1680 microversion: 2.1 time: 0.191212 Sep 26 18:07:33.741108 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 237/464] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:33 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:07:33.845627 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-84a785a4-b858-40f4-8d07-1e0ef95e6010 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:33.846239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-84a785a4-b858-40f4-8d07-1e0ef95e6010 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:33.852330 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-84a785a4-b858-40f4-8d07-1e0ef95e6010 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:33.852841 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-84a785a4-b858-40f4-8d07-1e0ef95e6010 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:33.853274 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-84a785a4-b858-40f4-8d07-1e0ef95e6010 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:33.853987 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-84a785a4-b858-40f4-8d07-1e0ef95e6010 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:33.855102 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-84a785a4-b858-40f4-8d07-1e0ef95e6010 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:33.855102 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-84a785a4-b858-40f4-8d07-1e0ef95e6010 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:34.014342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-84a785a4-b858-40f4-8d07-1e0ef95e6010 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:34.023829 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-84a785a4-b858-40f4-8d07-1e0ef95e6010 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:34.025283 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-84a785a4-b858-40f4-8d07-1e0ef95e6010 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:34.027282 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-84a785a4-b858-40f4-8d07-1e0ef95e6010 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.185390 Sep 26 18:07:34.027282 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 228/465] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:33 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:07:34.582810 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-080c3a68-07e4-43c1-b4c5-e9f32eb15807 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:34.583593 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-080c3a68-07e4-43c1-b4c5-e9f32eb15807 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:34.590193 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-080c3a68-07e4-43c1-b4c5-e9f32eb15807 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:34.590691 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-080c3a68-07e4-43c1-b4c5-e9f32eb15807 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:34.591127 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-080c3a68-07e4-43c1-b4c5-e9f32eb15807 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:34.591879 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-080c3a68-07e4-43c1-b4c5-e9f32eb15807 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:34.592341 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-080c3a68-07e4-43c1-b4c5-e9f32eb15807 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:34.592767 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-080c3a68-07e4-43c1-b4c5-e9f32eb15807 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:34.744316 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-080c3a68-07e4-43c1-b4c5-e9f32eb15807 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:34.752596 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-080c3a68-07e4-43c1-b4c5-e9f32eb15807 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1261 microversion: 2.1 time: 0.173828 Sep 26 18:07:34.753175 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 238/466] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:34 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:07:34.765991 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-bd7faabc-59a6-410a-aecf-6f219d9f524c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:34.766984 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-bd7faabc-59a6-410a-aecf-6f219d9f524c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:34.777350 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd7faabc-59a6-410a-aecf-6f219d9f524c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:34.777839 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd7faabc-59a6-410a-aecf-6f219d9f524c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:34.778277 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd7faabc-59a6-410a-aecf-6f219d9f524c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:34.779024 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd7faabc-59a6-410a-aecf-6f219d9f524c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:34.779693 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd7faabc-59a6-410a-aecf-6f219d9f524c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:34.780130 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd7faabc-59a6-410a-aecf-6f219d9f524c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:34.939140 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-bd7faabc-59a6-410a-aecf-6f219d9f524c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:34.947739 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-bd7faabc-59a6-410a-aecf-6f219d9f524c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1680 microversion: 2.1 time: 0.186397 Sep 26 18:07:34.948330 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 229/467] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:34 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:35.053329 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-254ed9bd-a236-4068-9067-fd1a38be2e59 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:35.053938 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-254ed9bd-a236-4068-9067-fd1a38be2e59 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:35.060157 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-254ed9bd-a236-4068-9067-fd1a38be2e59 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:35.061028 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-254ed9bd-a236-4068-9067-fd1a38be2e59 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:35.061206 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-254ed9bd-a236-4068-9067-fd1a38be2e59 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:35.061928 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-254ed9bd-a236-4068-9067-fd1a38be2e59 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:35.062475 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-254ed9bd-a236-4068-9067-fd1a38be2e59 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:35.062977 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-254ed9bd-a236-4068-9067-fd1a38be2e59 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:35.225031 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-254ed9bd-a236-4068-9067-fd1a38be2e59 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:35.235317 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-254ed9bd-a236-4068-9067-fd1a38be2e59 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:35.236838 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-254ed9bd-a236-4068-9067-fd1a38be2e59 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:35.238059 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-254ed9bd-a236-4068-9067-fd1a38be2e59 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.188719 Sep 26 18:07:35.238647 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 239/468] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:35 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:07:35.776735 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2f8bf070-cf84-4899-8c1a-80c5840cf445 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:35.777264 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2f8bf070-cf84-4899-8c1a-80c5840cf445 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:35.785053 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2f8bf070-cf84-4899-8c1a-80c5840cf445 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:35.785678 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2f8bf070-cf84-4899-8c1a-80c5840cf445 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:35.790693 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2f8bf070-cf84-4899-8c1a-80c5840cf445 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:35.790693 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2f8bf070-cf84-4899-8c1a-80c5840cf445 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:35.790693 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2f8bf070-cf84-4899-8c1a-80c5840cf445 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:35.790693 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2f8bf070-cf84-4899-8c1a-80c5840cf445 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:35.981373 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-55fbb73b-82ff-46cc-9b27-a97297169a13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:35.982075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-55fbb73b-82ff-46cc-9b27-a97297169a13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:35.990337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-55fbb73b-82ff-46cc-9b27-a97297169a13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:35.991131 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-55fbb73b-82ff-46cc-9b27-a97297169a13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:35.991757 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-55fbb73b-82ff-46cc-9b27-a97297169a13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:35.992647 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-55fbb73b-82ff-46cc-9b27-a97297169a13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:35.993274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-55fbb73b-82ff-46cc-9b27-a97297169a13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:35.993861 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-55fbb73b-82ff-46cc-9b27-a97297169a13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:36.026021 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2f8bf070-cf84-4899-8c1a-80c5840cf445 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:36.037980 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2f8bf070-cf84-4899-8c1a-80c5840cf445 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1261 microversion: 2.1 time: 0.263224 Sep 26 18:07:36.037980 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 230/469] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:35 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1261 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:36.265019 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-58258d27-52be-40c0-a6a0-36cfd8b3df3e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:36.265806 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-58258d27-52be-40c0-a6a0-36cfd8b3df3e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:36.272568 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-58258d27-52be-40c0-a6a0-36cfd8b3df3e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:36.273058 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-58258d27-52be-40c0-a6a0-36cfd8b3df3e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:36.273502 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-58258d27-52be-40c0-a6a0-36cfd8b3df3e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:36.274209 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-58258d27-52be-40c0-a6a0-36cfd8b3df3e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:36.274661 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-58258d27-52be-40c0-a6a0-36cfd8b3df3e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:36.275089 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-58258d27-52be-40c0-a6a0-36cfd8b3df3e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:36.594171 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-55fbb73b-82ff-46cc-9b27-a97297169a13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:36.602804 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-55fbb73b-82ff-46cc-9b27-a97297169a13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1680 microversion: 2.1 time: 0.625399 Sep 26 18:07:36.603784 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 240/470] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:35 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1680 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:36.604221 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-58258d27-52be-40c0-a6a0-36cfd8b3df3e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:36.615525 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-58258d27-52be-40c0-a6a0-36cfd8b3df3e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:36.617358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-58258d27-52be-40c0-a6a0-36cfd8b3df3e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:36.618537 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-58258d27-52be-40c0-a6a0-36cfd8b3df3e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.357896 Sep 26 18:07:36.619304 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 231/471] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:36 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:07:37.061589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-fe4decf5-59bc-4928-998e-90b99f252c4f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:37.062963 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-fe4decf5-59bc-4928-998e-90b99f252c4f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:37.072374 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fe4decf5-59bc-4928-998e-90b99f252c4f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:37.073105 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fe4decf5-59bc-4928-998e-90b99f252c4f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:37.075606 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fe4decf5-59bc-4928-998e-90b99f252c4f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:37.075606 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fe4decf5-59bc-4928-998e-90b99f252c4f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:37.075606 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fe4decf5-59bc-4928-998e-90b99f252c4f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:37.075606 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fe4decf5-59bc-4928-998e-90b99f252c4f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:37.308412 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-fe4decf5-59bc-4928-998e-90b99f252c4f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:37.318630 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-fe4decf5-59bc-4928-998e-90b99f252c4f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1261 microversion: 2.1 time: 0.262599 Sep 26 18:07:37.319253 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 241/472] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:37 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1261 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:37.455517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-5a2197b8-ff09-49d6-895f-448b6b8d83bf req-468e76df-f2fb-4cf4-afb7-54765ac10c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9682673d-b9ac-49a7-9f72-eef56dcbac73", "name": "network-vif-deleted", "tag": "88d9ddc3-ae2c-428a-b7ad-f212435e977b"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:07:37.472938 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-5a2197b8-ff09-49d6-895f-448b6b8d83bf req-468e76df-f2fb-4cf4-afb7-54765ac10c41 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:37.473411 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-5a2197b8-ff09-49d6-895f-448b6b8d83bf req-468e76df-f2fb-4cf4-afb7-54765ac10c41 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:37.474318 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-5a2197b8-ff09-49d6-895f-448b6b8d83bf req-468e76df-f2fb-4cf4-afb7-54765ac10c41 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:37.487629 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-5a2197b8-ff09-49d6-895f-448b6b8d83bf req-468e76df-f2fb-4cf4-afb7-54765ac10c41 service nova] Creating event network-vif-deleted:88d9ddc3-ae2c-428a-b7ad-f212435e977b for instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 on hv-cinder-85931 Sep 26 18:07:37.493731 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-5a2197b8-ff09-49d6-895f-448b6b8d83bf req-468e76df-f2fb-4cf4-afb7-54765ac10c41 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042860 Sep 26 18:07:37.497399 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 232/473] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:07:37.626941 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-889936ba-bc78-47a4-bfb8-3f3beb775a5d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:37.627845 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-889936ba-bc78-47a4-bfb8-3f3beb775a5d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:37.635126 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-889936ba-bc78-47a4-bfb8-3f3beb775a5d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:37.635701 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-889936ba-bc78-47a4-bfb8-3f3beb775a5d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:37.636171 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-889936ba-bc78-47a4-bfb8-3f3beb775a5d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:37.636867 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-889936ba-bc78-47a4-bfb8-3f3beb775a5d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:37.637616 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-889936ba-bc78-47a4-bfb8-3f3beb775a5d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:37.638083 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-889936ba-bc78-47a4-bfb8-3f3beb775a5d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:37.648582 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f25f5e06-9ab7-40da-9bde-7303a84de8f8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:37.651623 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f25f5e06-9ab7-40da-9bde-7303a84de8f8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:37.659931 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f25f5e06-9ab7-40da-9bde-7303a84de8f8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:37.660475 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f25f5e06-9ab7-40da-9bde-7303a84de8f8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:37.660860 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f25f5e06-9ab7-40da-9bde-7303a84de8f8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:37.661915 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f25f5e06-9ab7-40da-9bde-7303a84de8f8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:37.662373 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f25f5e06-9ab7-40da-9bde-7303a84de8f8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:37.662815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f25f5e06-9ab7-40da-9bde-7303a84de8f8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:37.668976 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:37.720816 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-889936ba-bc78-47a4-bfb8-3f3beb775a5d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:37.732259 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-889936ba-bc78-47a4-bfb8-3f3beb775a5d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1613 microversion: 2.1 time: 0.109605 Sep 26 18:07:37.750512 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 242/474] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:37 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1613 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:37.835347 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f25f5e06-9ab7-40da-9bde-7303a84de8f8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:37.845525 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f25f5e06-9ab7-40da-9bde-7303a84de8f8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:37.846885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f25f5e06-9ab7-40da-9bde-7303a84de8f8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:37.848082 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f25f5e06-9ab7-40da-9bde-7303a84de8f8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.205153 Sep 26 18:07:37.850923 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 233/475] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:37 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:07:38.345631 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-98f11d04-64fe-4443-a380-04c1b01c0de4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:38.346439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-98f11d04-64fe-4443-a380-04c1b01c0de4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:38.353650 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-98f11d04-64fe-4443-a380-04c1b01c0de4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:38.354216 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-98f11d04-64fe-4443-a380-04c1b01c0de4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:38.354652 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-98f11d04-64fe-4443-a380-04c1b01c0de4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:38.355560 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-98f11d04-64fe-4443-a380-04c1b01c0de4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:38.356050 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-98f11d04-64fe-4443-a380-04c1b01c0de4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:38.356546 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-98f11d04-64fe-4443-a380-04c1b01c0de4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:38.504982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-98f11d04-64fe-4443-a380-04c1b01c0de4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:38.513627 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-98f11d04-64fe-4443-a380-04c1b01c0de4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1261 microversion: 2.1 time: 0.172291 Sep 26 18:07:38.514202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 243/476] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:38 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:07:38.759781 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-12f8add6-062f-4545-980a-3da7b9470c74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:38.760501 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-12f8add6-062f-4545-980a-3da7b9470c74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:38.770460 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-12f8add6-062f-4545-980a-3da7b9470c74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:38.771098 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-12f8add6-062f-4545-980a-3da7b9470c74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:38.771597 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-12f8add6-062f-4545-980a-3da7b9470c74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:38.772653 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-12f8add6-062f-4545-980a-3da7b9470c74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:38.773104 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-12f8add6-062f-4545-980a-3da7b9470c74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:38.773522 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-12f8add6-062f-4545-980a-3da7b9470c74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:38.808691 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-12f8add6-062f-4545-980a-3da7b9470c74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:38.809164 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-12f8add6-062f-4545-980a-3da7b9470c74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:38.809594 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-12f8add6-062f-4545-980a-3da7b9470c74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:38.810037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-12f8add6-062f-4545-980a-3da7b9470c74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lazy-loading 'fault' on Instance uuid 9682673d-b9ac-49a7-9f72-eef56dcbac73 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:07:38.852885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-12f8add6-062f-4545-980a-3da7b9470c74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:38.861244 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-12f8add6-062f-4545-980a-3da7b9470c74 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 200 len: 1331 microversion: 2.1 time: 0.106157 Sep 26 18:07:38.861798 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 234/477] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:38 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:38.878432 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-85cf8a7d-e37b-499e-bc0a-1ded49863756 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:38.878432 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-85cf8a7d-e37b-499e-bc0a-1ded49863756 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:38.883538 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85cf8a7d-e37b-499e-bc0a-1ded49863756 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:38.884059 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85cf8a7d-e37b-499e-bc0a-1ded49863756 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:38.884497 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85cf8a7d-e37b-499e-bc0a-1ded49863756 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:38.885192 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85cf8a7d-e37b-499e-bc0a-1ded49863756 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:38.885969 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85cf8a7d-e37b-499e-bc0a-1ded49863756 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:38.886406 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85cf8a7d-e37b-499e-bc0a-1ded49863756 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:39.055624 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-85cf8a7d-e37b-499e-bc0a-1ded49863756 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:39.059067 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:39.064340 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-85cf8a7d-e37b-499e-bc0a-1ded49863756 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:39.065911 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-85cf8a7d-e37b-499e-bc0a-1ded49863756 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:39.067374 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-85cf8a7d-e37b-499e-bc0a-1ded49863756 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.194163 Sep 26 18:07:39.068063 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 244/478] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:38 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:07:39.537614 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1189ab77-4bc6-4df9-8954-c7f52deb0537 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:39.539145 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1189ab77-4bc6-4df9-8954-c7f52deb0537 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:39.545318 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1189ab77-4bc6-4df9-8954-c7f52deb0537 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:39.546074 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1189ab77-4bc6-4df9-8954-c7f52deb0537 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:39.546653 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1189ab77-4bc6-4df9-8954-c7f52deb0537 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:39.547354 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1189ab77-4bc6-4df9-8954-c7f52deb0537 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:39.547835 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1189ab77-4bc6-4df9-8954-c7f52deb0537 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:39.548260 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1189ab77-4bc6-4df9-8954-c7f52deb0537 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:39.709452 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1189ab77-4bc6-4df9-8954-c7f52deb0537 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:39.717999 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1189ab77-4bc6-4df9-8954-c7f52deb0537 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1261 microversion: 2.1 time: 0.184490 Sep 26 18:07:39.719679 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 235/479] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:39 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:39.886972 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-67b74617-c73e-4f10-8ffa-87e5e3f9a715 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:39.887913 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-67b74617-c73e-4f10-8ffa-87e5e3f9a715 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:39.894765 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-67b74617-c73e-4f10-8ffa-87e5e3f9a715 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:39.898065 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-67b74617-c73e-4f10-8ffa-87e5e3f9a715 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:39.898065 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-67b74617-c73e-4f10-8ffa-87e5e3f9a715 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:39.898065 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-67b74617-c73e-4f10-8ffa-87e5e3f9a715 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:39.898065 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-67b74617-c73e-4f10-8ffa-87e5e3f9a715 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:39.898563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-67b74617-c73e-4f10-8ffa-87e5e3f9a715 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:39.910839 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-67b74617-c73e-4f10-8ffa-87e5e3f9a715 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] HTTP exception thrown: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-67b74617-c73e-4f10-8ffa-87e5e3f9a715 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Request method failure captured: Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 HTTP/1.1 Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMelsNex1FlD2CBY8G-ysnjsye_l-7KQaYKxzjq-uqqw_c6lt3XOkxaeXEOSBPxdrGfGNF6J_jwjGWJdIRzcPmWbMtwg-2UVrF8ghY8jl9NOGZb0sL_3XrXpF2FeqtmN-NjzE_b12zyopUCDg2jN5eXXFmLWv81UC7SHabJvYKq1cYR8 Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:07:39.912513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:07:39.913957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:07:39.913957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:07:39.913957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:07:39.913957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:07:39.913957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:07:39.913957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:07:39.913957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:07:39.913957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 0bede3a601f941e7abc9fd16983679b2 Sep 26 18:07:39.913957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:07:39.913957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:07:39.913957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. Sep 26 18:07:39.913957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': '9682673d-b9ac-49a7-9f72-eef56dcbac73'} Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:07:39.914787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. Sep 26 18:07:39.916106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:07:39.917121 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-67b74617-c73e-4f10-8ffa-87e5e3f9a715 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Returning 404 to user: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:07:39.917121 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-67b74617-c73e-4f10-8ffa-87e5e3f9a715 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 404 len: 111 microversion: 2.1 time: 0.032070 Sep 26 18:07:39.917121 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 245/480] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:39 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:07:39.924076 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-adae9510-ddc7-4996-b11e-bb7edea6cdd1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '.version_select at 0x7f3a74b2b0d0>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:40.017129 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-adae9510-ddc7-4996-b11e-bb7edea6cdd1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-127912315" status: 202 len: 0 microversion: 2.1 time: 0.097928 Sep 26 18:07:40.017712 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 236/481] 10.222.0.67 () {58 vars in 1218 bytes} [Mon Sep 26 18:07:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-127912315 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:07:40.093415 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c972553a-5dc4-401a-b494-49344c4c4413 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:40.093980 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c972553a-5dc4-401a-b494-49344c4c4413 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:40.097701 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:40.101376 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c972553a-5dc4-401a-b494-49344c4c4413 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:40.101963 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c972553a-5dc4-401a-b494-49344c4c4413 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:40.102388 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c972553a-5dc4-401a-b494-49344c4c4413 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:40.103091 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c972553a-5dc4-401a-b494-49344c4c4413 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:40.103550 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c972553a-5dc4-401a-b494-49344c4c4413 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:40.104031 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c972553a-5dc4-401a-b494-49344c4c4413 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:40.247874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c972553a-5dc4-401a-b494-49344c4c4413 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:40.263134 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c972553a-5dc4-401a-b494-49344c4c4413 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:40.265018 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c972553a-5dc4-401a-b494-49344c4c4413 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:40.266608 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c972553a-5dc4-401a-b494-49344c4c4413 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.177344 Sep 26 18:07:40.268868 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 246/482] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:40 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:07:40.747407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-36df6d13-d2ed-4c9c-8443-a9e7fc3de4c4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:40.748086 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-36df6d13-d2ed-4c9c-8443-a9e7fc3de4c4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:40.756604 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-36df6d13-d2ed-4c9c-8443-a9e7fc3de4c4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:40.757103 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-36df6d13-d2ed-4c9c-8443-a9e7fc3de4c4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:40.758085 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-36df6d13-d2ed-4c9c-8443-a9e7fc3de4c4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:40.758811 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-36df6d13-d2ed-4c9c-8443-a9e7fc3de4c4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:40.759268 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-36df6d13-d2ed-4c9c-8443-a9e7fc3de4c4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:40.759743 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-36df6d13-d2ed-4c9c-8443-a9e7fc3de4c4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:40.850601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-55c2903a-d2fb-4b5d-97bc-1a1669d75c98 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Action: 'create', calling method: .version_select at 0x7f3a74a0edc0>, body: {"keypair": {"name": "tempest-keypair-1437785154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ+LPJwXM7kBYioi2kp0eVW+wnk1IY+xEVryYTlK+IXjLDBWNBvqo0/+IlpuK7eCi7nB1iBmLkv6mJPvMEQxetaAPBav8r/bKpKUxQFd0DrBj+8aiUQE7h4z6aUYx7PJg=="}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:07:40.868118 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-55c2903a-d2fb-4b5d-97bc-1a1669d75c98 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Getting quotas for project ffa58ff5197e48709d5c90ec334b9403. Resources: {'key_pairs'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:07:40.872542 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-55c2903a-d2fb-4b5d-97bc-1a1669d75c98 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Getting quotas for user 0bede3a601f941e7abc9fd16983679b2 and project ffa58ff5197e48709d5c90ec334b9403. Resources: {'key_pairs'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:07:40.913282 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-36df6d13-d2ed-4c9c-8443-a9e7fc3de4c4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:40.920949 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-36df6d13-d2ed-4c9c-8443-a9e7fc3de4c4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1261 microversion: 2.1 time: 0.179056 Sep 26 18:07:40.922165 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 237/483] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:40 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:40.988356 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-55c2903a-d2fb-4b5d-97bc-1a1669d75c98 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142395 Sep 26 18:07:40.988954 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 247/484] 10.222.0.67 () {60 vars in 1159 bytes} [Mon Sep 26 18:07:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:07:41.292645 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-af5f61c5-df17-43dc-8799-d96b362873e6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:41.293271 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-af5f61c5-df17-43dc-8799-d96b362873e6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:41.300189 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af5f61c5-df17-43dc-8799-d96b362873e6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:41.300674 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af5f61c5-df17-43dc-8799-d96b362873e6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:41.301103 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af5f61c5-df17-43dc-8799-d96b362873e6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:41.301797 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af5f61c5-df17-43dc-8799-d96b362873e6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:41.302244 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af5f61c5-df17-43dc-8799-d96b362873e6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:41.302661 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-af5f61c5-df17-43dc-8799-d96b362873e6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:41.452277 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-af5f61c5-df17-43dc-8799-d96b362873e6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:41.461329 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-af5f61c5-df17-43dc-8799-d96b362873e6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:41.462967 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-af5f61c5-df17-43dc-8799-d96b362873e6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:41.464181 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-af5f61c5-df17-43dc-8799-d96b362873e6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.175484 Sep 26 18:07:41.464842 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 238/485] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:41 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:07:41.945169 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-75ab6dcf-5687-4790-ae8c-fa261a70db71 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:41.945841 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-75ab6dcf-5687-4790-ae8c-fa261a70db71 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:41.952790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75ab6dcf-5687-4790-ae8c-fa261a70db71 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:41.953293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75ab6dcf-5687-4790-ae8c-fa261a70db71 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:41.953738 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75ab6dcf-5687-4790-ae8c-fa261a70db71 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:41.954438 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75ab6dcf-5687-4790-ae8c-fa261a70db71 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:41.954902 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75ab6dcf-5687-4790-ae8c-fa261a70db71 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:41.955334 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75ab6dcf-5687-4790-ae8c-fa261a70db71 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:42.112669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-75ab6dcf-5687-4790-ae8c-fa261a70db71 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:42.120680 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-75ab6dcf-5687-4790-ae8c-fa261a70db71 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1261 microversion: 2.1 time: 0.180059 Sep 26 18:07:42.121248 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 248/486] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:41 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:42.262787 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f1f5b6bd-18ae-4227-9252-5a287348bec2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e2f368f-d3ce-48e4-b1e3-4efa15e1f1a1"}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:07:42.265297 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f1f5b6bd-18ae-4227-9252-5a287348bec2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:42.271848 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1f5b6bd-18ae-4227-9252-5a287348bec2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:42.272336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1f5b6bd-18ae-4227-9252-5a287348bec2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:42.272767 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1f5b6bd-18ae-4227-9252-5a287348bec2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:42.273456 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1f5b6bd-18ae-4227-9252-5a287348bec2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:42.274047 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1f5b6bd-18ae-4227-9252-5a287348bec2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:42.274471 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f1f5b6bd-18ae-4227-9252-5a287348bec2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:42.490479 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-4bdb928b-69f1-4f96-85c8-fbae1950da95 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:42.491391 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-4bdb928b-69f1-4f96-85c8-fbae1950da95 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:42.497853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4bdb928b-69f1-4f96-85c8-fbae1950da95 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:42.498342 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4bdb928b-69f1-4f96-85c8-fbae1950da95 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:42.498778 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4bdb928b-69f1-4f96-85c8-fbae1950da95 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:42.499503 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4bdb928b-69f1-4f96-85c8-fbae1950da95 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:42.500093 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4bdb928b-69f1-4f96-85c8-fbae1950da95 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:42.500528 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4bdb928b-69f1-4f96-85c8-fbae1950da95 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:42.686501 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-4bdb928b-69f1-4f96-85c8-fbae1950da95 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:42.694715 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-4bdb928b-69f1-4f96-85c8-fbae1950da95 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:42.696183 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-4bdb928b-69f1-4f96-85c8-fbae1950da95 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:42.697340 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-4bdb928b-69f1-4f96-85c8-fbae1950da95 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.210778 Sep 26 18:07:42.697896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 249/487] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:42 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:07:43.145213 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ca8ae8a4-6016-43c8-84d5-fa5efcfe05c5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:43.145984 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ca8ae8a4-6016-43c8-84d5-fa5efcfe05c5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:43.152968 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ca8ae8a4-6016-43c8-84d5-fa5efcfe05c5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:43.153463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ca8ae8a4-6016-43c8-84d5-fa5efcfe05c5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:43.153889 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ca8ae8a4-6016-43c8-84d5-fa5efcfe05c5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:43.154770 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ca8ae8a4-6016-43c8-84d5-fa5efcfe05c5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:43.156470 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ca8ae8a4-6016-43c8-84d5-fa5efcfe05c5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:43.156894 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ca8ae8a4-6016-43c8-84d5-fa5efcfe05c5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:43.323919 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ca8ae8a4-6016-43c8-84d5-fa5efcfe05c5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:43.332572 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ca8ae8a4-6016-43c8-84d5-fa5efcfe05c5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1261 microversion: 2.1 time: 0.192024 Sep 26 18:07:43.333158 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 250/488] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:43 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1261 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:07:43.445816 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-3a8f1660-c6f8-4aaf-9638-bf74b813ae09 req-17ab56c2-77cf-4812-ad4e-e86296b56ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19e1622-6521-459d-9db1-80abd4bcf0f8", "name": "network-vif-plugged", "status": "completed", "tag": "df9e6e2c-d105-4f6a-aaf7-3619c1f5c26c"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:07:43.455564 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-3a8f1660-c6f8-4aaf-9638-bf74b813ae09 req-17ab56c2-77cf-4812-ad4e-e86296b56ef4 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:43.456074 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-3a8f1660-c6f8-4aaf-9638-bf74b813ae09 req-17ab56c2-77cf-4812-ad4e-e86296b56ef4 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:43.456526 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-3a8f1660-c6f8-4aaf-9638-bf74b813ae09 req-17ab56c2-77cf-4812-ad4e-e86296b56ef4 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:43.467937 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-3a8f1660-c6f8-4aaf-9638-bf74b813ae09 req-17ab56c2-77cf-4812-ad4e-e86296b56ef4 service nova] Creating event network-vif-plugged:df9e6e2c-d105-4f6a-aaf7-3619c1f5c26c for instance b19e1622-6521-459d-9db1-80abd4bcf0f8 on hv-cinder-85931 Sep 26 18:07:43.473688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-3a8f1660-c6f8-4aaf-9638-bf74b813ae09 req-17ab56c2-77cf-4812-ad4e-e86296b56ef4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033886 Sep 26 18:07:43.474343 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 251/489] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:07:43.629857 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1766327508", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff0911ec-d0cb-47aa-9835-b96611526a51"}], "security_groups": [{"name": "tempest-securitygroup--1553917480"}], "key_name": "tempest-keypair-1437785154", "user_data": "}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:07:43.740936 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.network.neutron [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] validate_networks() for [('ff0911ec-d0cb-47aa-9835-b96611526a51', None, None, None, None, None)] {{(pid=121029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:07:44.179484 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Flavor limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:07:44.180113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Image limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:07:44.180407 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Flavor pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:07:44.180813 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Image pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:07:44.181228 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:07:44.190258 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:44.190739 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:44.191168 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:44.191911 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:44.192364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:44.192788 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:44.202164 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f1f5b6bd-18ae-4227-9252-5a287348bec2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "POST /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.943516 Sep 26 18:07:44.210373 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 239/490] 10.222.0.67 () {60 vars in 1323 bytes} [Mon Sep 26 18:07:42 2022] POST /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-volume_attachments => generated 194 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:07:44.220748 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3b3a2a59-630b-463b-840b-ccaccf6e77a6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:44.221718 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-3b3a2a59-630b-463b-840b-ccaccf6e77a6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:44.228741 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b3a2a59-630b-463b-840b-ccaccf6e77a6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:44.229375 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b3a2a59-630b-463b-840b-ccaccf6e77a6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:44.229744 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b3a2a59-630b-463b-840b-ccaccf6e77a6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:44.231027 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b3a2a59-630b-463b-840b-ccaccf6e77a6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:44.231752 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b3a2a59-630b-463b-840b-ccaccf6e77a6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:44.232188 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b3a2a59-630b-463b-840b-ccaccf6e77a6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:44.246614 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Getting quotas for project ffa58ff5197e48709d5c90ec334b9403. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:07:44.252409 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Getting quotas for user 0bede3a601f941e7abc9fd16983679b2 and project ffa58ff5197e48709d5c90ec334b9403. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:07:44.267946 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Going to run 1 instances... {{(pid=121029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:07:44.270529 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:07:44.385919 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3b3a2a59-630b-463b-840b-ccaccf6e77a6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:44.395531 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3b3a2a59-630b-463b-840b-ccaccf6e77a6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:44.396994 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3b3a2a59-630b-463b-840b-ccaccf6e77a6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:44.398166 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-3b3a2a59-630b-463b-840b-ccaccf6e77a6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.185072 Sep 26 18:07:44.398714 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 240/491] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:44 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:07:44.403315 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-db6856e5-f9be-4eed-9be9-c39089475ffa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:44.403948 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-db6856e5-f9be-4eed-9be9-c39089475ffa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:44.410592 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-db6856e5-f9be-4eed-9be9-c39089475ffa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:44.411744 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-db6856e5-f9be-4eed-9be9-c39089475ffa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:44.412821 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-db6856e5-f9be-4eed-9be9-c39089475ffa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:44.414495 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-db6856e5-f9be-4eed-9be9-c39089475ffa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:44.415441 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-db6856e5-f9be-4eed-9be9-c39089475ffa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:44.416532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-db6856e5-f9be-4eed-9be9-c39089475ffa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:44.428794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e50f886f-c5dc-4df5-b977-7bcfcbd08317 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.803274 Sep 26 18:07:44.436732 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 252/492] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:07:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 18:07:44.446150 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1c955119-3b61-42e7-a232-88cd6008453e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:44.447190 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1c955119-3b61-42e7-a232-88cd6008453e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:44.537993 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1c955119-3b61-42e7-a232-88cd6008453e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:44.546088 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1c955119-3b61-42e7-a232-88cd6008453e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1242 microversion: 2.1 time: 0.106777 Sep 26 18:07:44.549720 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 253/493] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:44 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:44.624208 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-db6856e5-f9be-4eed-9be9-c39089475ffa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:44.634895 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-db6856e5-f9be-4eed-9be9-c39089475ffa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1261 microversion: 2.1 time: 0.235097 Sep 26 18:07:44.635551 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 241/494] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:44 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1261 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:45.425156 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7b32bbd0-d20b-402f-9e82-f4c9e47422de tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:45.425777 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7b32bbd0-d20b-402f-9e82-f4c9e47422de tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:45.432774 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7b32bbd0-d20b-402f-9e82-f4c9e47422de tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:45.433267 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7b32bbd0-d20b-402f-9e82-f4c9e47422de tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:45.433709 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7b32bbd0-d20b-402f-9e82-f4c9e47422de tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:45.434411 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7b32bbd0-d20b-402f-9e82-f4c9e47422de tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:45.434879 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7b32bbd0-d20b-402f-9e82-f4c9e47422de tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:45.435310 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7b32bbd0-d20b-402f-9e82-f4c9e47422de tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:45.573916 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-54a1e632-b87f-4b36-9c75-91c223c570ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:45.574525 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-54a1e632-b87f-4b36-9c75-91c223c570ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:45.582822 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-54a1e632-b87f-4b36-9c75-91c223c570ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:45.583310 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-54a1e632-b87f-4b36-9c75-91c223c570ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:45.583779 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-54a1e632-b87f-4b36-9c75-91c223c570ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:45.584474 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-54a1e632-b87f-4b36-9c75-91c223c570ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:45.584926 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-54a1e632-b87f-4b36-9c75-91c223c570ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:45.585346 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-54a1e632-b87f-4b36-9c75-91c223c570ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:45.593900 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7b32bbd0-d20b-402f-9e82-f4c9e47422de tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:45.602057 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7b32bbd0-d20b-402f-9e82-f4c9e47422de tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:45.603510 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7b32bbd0-d20b-402f-9e82-f4c9e47422de tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:45.604696 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7b32bbd0-d20b-402f-9e82-f4c9e47422de tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.184432 Sep 26 18:07:45.605253 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 254/495] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:45 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:07:45.648993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-54a1e632-b87f-4b36-9c75-91c223c570ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:45.658307 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-54a1e632-b87f-4b36-9c75-91c223c570ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1246 microversion: 2.1 time: 0.090481 Sep 26 18:07:45.658880 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 242/496] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:45 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:45.659342 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9a5cdf73-58d4-4971-a398-2c5000479041 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:45.660084 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9a5cdf73-58d4-4971-a398-2c5000479041 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:45.666298 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9a5cdf73-58d4-4971-a398-2c5000479041 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:45.666792 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9a5cdf73-58d4-4971-a398-2c5000479041 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:45.667233 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9a5cdf73-58d4-4971-a398-2c5000479041 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:45.667981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9a5cdf73-58d4-4971-a398-2c5000479041 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:45.668424 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9a5cdf73-58d4-4971-a398-2c5000479041 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:45.668853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9a5cdf73-58d4-4971-a398-2c5000479041 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:45.816543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9a5cdf73-58d4-4971-a398-2c5000479041 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:45.834847 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9a5cdf73-58d4-4971-a398-2c5000479041 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1261 microversion: 2.1 time: 0.179966 Sep 26 18:07:45.835550 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 255/497] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:45 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:07:46.630945 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6ab3ef8c-3fac-478e-9b9b-7d4cd571456b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:46.631590 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-6ab3ef8c-3fac-478e-9b9b-7d4cd571456b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:46.638391 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ab3ef8c-3fac-478e-9b9b-7d4cd571456b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:46.638874 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ab3ef8c-3fac-478e-9b9b-7d4cd571456b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:46.639422 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ab3ef8c-3fac-478e-9b9b-7d4cd571456b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:46.640214 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ab3ef8c-3fac-478e-9b9b-7d4cd571456b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:46.640997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ab3ef8c-3fac-478e-9b9b-7d4cd571456b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:46.641509 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ab3ef8c-3fac-478e-9b9b-7d4cd571456b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:46.685346 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d934a0e4-64c6-4939-b589-19be74401603 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:46.686296 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d934a0e4-64c6-4939-b589-19be74401603 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:46.692919 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d934a0e4-64c6-4939-b589-19be74401603 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:46.693591 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d934a0e4-64c6-4939-b589-19be74401603 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:46.694332 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d934a0e4-64c6-4939-b589-19be74401603 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:46.695170 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d934a0e4-64c6-4939-b589-19be74401603 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:46.695798 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d934a0e4-64c6-4939-b589-19be74401603 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:46.696325 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d934a0e4-64c6-4939-b589-19be74401603 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:46.773529 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d934a0e4-64c6-4939-b589-19be74401603 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:46.782213 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d934a0e4-64c6-4939-b589-19be74401603 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1238 microversion: 2.1 time: 0.100905 Sep 26 18:07:46.783128 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 256/498] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:46 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:46.808691 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6ab3ef8c-3fac-478e-9b9b-7d4cd571456b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:46.819322 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6ab3ef8c-3fac-478e-9b9b-7d4cd571456b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:46.820972 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6ab3ef8c-3fac-478e-9b9b-7d4cd571456b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:46.822118 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-6ab3ef8c-3fac-478e-9b9b-7d4cd571456b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.195326 Sep 26 18:07:46.822665 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 243/499] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:46 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:07:46.858562 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-93dd6b0d-6981-4c25-829b-fcf18f2c27c7 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:46.859791 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-93dd6b0d-6981-4c25-829b-fcf18f2c27c7 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:46.867020 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93dd6b0d-6981-4c25-829b-fcf18f2c27c7 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:46.867904 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93dd6b0d-6981-4c25-829b-fcf18f2c27c7 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:46.868541 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93dd6b0d-6981-4c25-829b-fcf18f2c27c7 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:46.869501 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93dd6b0d-6981-4c25-829b-fcf18f2c27c7 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:46.870127 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93dd6b0d-6981-4c25-829b-fcf18f2c27c7 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:46.875406 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93dd6b0d-6981-4c25-829b-fcf18f2c27c7 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:47.068511 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-93dd6b0d-6981-4c25-829b-fcf18f2c27c7 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:47.079027 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-93dd6b0d-6981-4c25-829b-fcf18f2c27c7 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1261 microversion: 2.1 time: 0.224403 Sep 26 18:07:47.079638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 257/500] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:46 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1261 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:47.808979 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-850b700f-11d0-41ae-a208-94b94fc2f1a5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:47.809776 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-850b700f-11d0-41ae-a208-94b94fc2f1a5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:47.816501 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-850b700f-11d0-41ae-a208-94b94fc2f1a5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:47.817048 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-850b700f-11d0-41ae-a208-94b94fc2f1a5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:47.817545 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-850b700f-11d0-41ae-a208-94b94fc2f1a5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:47.818210 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-850b700f-11d0-41ae-a208-94b94fc2f1a5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:47.818691 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-850b700f-11d0-41ae-a208-94b94fc2f1a5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:47.819116 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-850b700f-11d0-41ae-a208-94b94fc2f1a5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:47.848656 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-de659e22-b71b-43b0-899f-9cbf9a72f48e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:47.849412 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-de659e22-b71b-43b0-899f-9cbf9a72f48e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:47.855829 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-de659e22-b71b-43b0-899f-9cbf9a72f48e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:47.856334 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-de659e22-b71b-43b0-899f-9cbf9a72f48e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:47.856777 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-de659e22-b71b-43b0-899f-9cbf9a72f48e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:47.857482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-de659e22-b71b-43b0-899f-9cbf9a72f48e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:47.857946 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-de659e22-b71b-43b0-899f-9cbf9a72f48e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:47.858376 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-de659e22-b71b-43b0-899f-9cbf9a72f48e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:47.890928 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-850b700f-11d0-41ae-a208-94b94fc2f1a5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:47.899171 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-850b700f-11d0-41ae-a208-94b94fc2f1a5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1294 microversion: 2.1 time: 0.093997 Sep 26 18:07:47.899772 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 244/501] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:47 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:07:48.057358 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-de659e22-b71b-43b0-899f-9cbf9a72f48e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:48.068453 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-de659e22-b71b-43b0-899f-9cbf9a72f48e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:48.070301 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-de659e22-b71b-43b0-899f-9cbf9a72f48e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:48.071977 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-de659e22-b71b-43b0-899f-9cbf9a72f48e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.228244 Sep 26 18:07:48.072900 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 258/502] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:47 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:07:48.116146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-02a0a1ba-3142-4e62-99a8-7cc7c85c3afe tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:48.116750 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-02a0a1ba-3142-4e62-99a8-7cc7c85c3afe tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:48.122671 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-02a0a1ba-3142-4e62-99a8-7cc7c85c3afe tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:48.123165 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-02a0a1ba-3142-4e62-99a8-7cc7c85c3afe tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:48.123598 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-02a0a1ba-3142-4e62-99a8-7cc7c85c3afe tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:48.124312 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-02a0a1ba-3142-4e62-99a8-7cc7c85c3afe tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:48.126108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-02a0a1ba-3142-4e62-99a8-7cc7c85c3afe tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:48.126723 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-02a0a1ba-3142-4e62-99a8-7cc7c85c3afe tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:48.313369 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-02a0a1ba-3142-4e62-99a8-7cc7c85c3afe tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:48.321216 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-02a0a1ba-3142-4e62-99a8-7cc7c85c3afe tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1444 microversion: 2.1 time: 0.208873 Sep 26 18:07:48.321964 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 245/503] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:48 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1444 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:48.345105 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7a04dcf8-c594-4394-8c53-4b9b8c9d8746 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:48.345719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7a04dcf8-c594-4394-8c53-4b9b8c9d8746 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:48.360753 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7a04dcf8-c594-4394-8c53-4b9b8c9d8746 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:48.360753 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7a04dcf8-c594-4394-8c53-4b9b8c9d8746 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:48.360753 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7a04dcf8-c594-4394-8c53-4b9b8c9d8746 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:48.360753 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7a04dcf8-c594-4394-8c53-4b9b8c9d8746 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:48.361362 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7a04dcf8-c594-4394-8c53-4b9b8c9d8746 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:48.361362 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7a04dcf8-c594-4394-8c53-4b9b8c9d8746 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:48.563433 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7a04dcf8-c594-4394-8c53-4b9b8c9d8746 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:48.572843 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7a04dcf8-c594-4394-8c53-4b9b8c9d8746 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1444 microversion: 2.1 time: 0.231806 Sep 26 18:07:48.578655 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 259/504] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:48 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1444 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:07:48.927056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3b8ab93c-5620-4bc9-927f-df8351819706 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:48.928251 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-3b8ab93c-5620-4bc9-927f-df8351819706 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:48.933749 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:48.939703 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b8ab93c-5620-4bc9-927f-df8351819706 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:48.940276 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b8ab93c-5620-4bc9-927f-df8351819706 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:48.944993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b8ab93c-5620-4bc9-927f-df8351819706 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:48.944993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b8ab93c-5620-4bc9-927f-df8351819706 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:48.944993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b8ab93c-5620-4bc9-927f-df8351819706 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:48.944993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b8ab93c-5620-4bc9-927f-df8351819706 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:49.102240 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5dc26a48-1cc5-425b-af15-b9d036bb33c5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:49.103122 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-5dc26a48-1cc5-425b-af15-b9d036bb33c5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:49.111198 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5dc26a48-1cc5-425b-af15-b9d036bb33c5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:49.111871 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5dc26a48-1cc5-425b-af15-b9d036bb33c5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:49.112392 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5dc26a48-1cc5-425b-af15-b9d036bb33c5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:49.113258 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5dc26a48-1cc5-425b-af15-b9d036bb33c5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:49.113828 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5dc26a48-1cc5-425b-af15-b9d036bb33c5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:49.114491 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5dc26a48-1cc5-425b-af15-b9d036bb33c5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:49.365485 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3b8ab93c-5620-4bc9-927f-df8351819706 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:49.373865 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-3b8ab93c-5620-4bc9-927f-df8351819706 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1300 microversion: 2.1 time: 0.454177 Sep 26 18:07:49.374700 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 246/505] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:48 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1300 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:49.556503 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5dc26a48-1cc5-425b-af15-b9d036bb33c5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:49.568431 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5dc26a48-1cc5-425b-af15-b9d036bb33c5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:49.570899 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5dc26a48-1cc5-425b-af15-b9d036bb33c5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:49.573195 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5dc26a48-1cc5-425b-af15-b9d036bb33c5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1744 microversion: 2.20 time: 0.475852 Sep 26 18:07:49.574065 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 260/506] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:49 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1744 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:07:50.401516 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-278a73cd-2d5d-4ce4-8532-b9553a7f97bd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:50.402284 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-278a73cd-2d5d-4ce4-8532-b9553a7f97bd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:50.410075 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-278a73cd-2d5d-4ce4-8532-b9553a7f97bd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:50.410689 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-278a73cd-2d5d-4ce4-8532-b9553a7f97bd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:50.411325 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-278a73cd-2d5d-4ce4-8532-b9553a7f97bd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:50.412139 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-278a73cd-2d5d-4ce4-8532-b9553a7f97bd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:50.412690 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-278a73cd-2d5d-4ce4-8532-b9553a7f97bd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:50.413181 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-278a73cd-2d5d-4ce4-8532-b9553a7f97bd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:50.619963 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7e4d086a-a559-49a6-b683-d1aa21b95489 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:50.621041 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7e4d086a-a559-49a6-b683-d1aa21b95489 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:50.628903 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e4d086a-a559-49a6-b683-d1aa21b95489 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:50.629406 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e4d086a-a559-49a6-b683-d1aa21b95489 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:50.629848 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e4d086a-a559-49a6-b683-d1aa21b95489 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:50.630557 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e4d086a-a559-49a6-b683-d1aa21b95489 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:50.631045 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e4d086a-a559-49a6-b683-d1aa21b95489 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:50.631474 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7e4d086a-a559-49a6-b683-d1aa21b95489 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:50.675004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-278a73cd-2d5d-4ce4-8532-b9553a7f97bd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:50.677875 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-278a73cd-2d5d-4ce4-8532-b9553a7f97bd tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1368 microversion: 2.1 time: 0.280806 Sep 26 18:07:50.678466 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 247/507] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:50 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1368 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:50.829640 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7e4d086a-a559-49a6-b683-d1aa21b95489 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:50.838271 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7e4d086a-a559-49a6-b683-d1aa21b95489 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:50.839750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7e4d086a-a559-49a6-b683-d1aa21b95489 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:50.840948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7e4d086a-a559-49a6-b683-d1aa21b95489 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1744 microversion: 2.20 time: 0.228439 Sep 26 18:07:50.841506 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 261/508] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:50 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1744 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:07:51.701872 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-95972390-4ad3-4664-b536-e78f9724ee7e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:51.703233 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-95972390-4ad3-4664-b536-e78f9724ee7e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:51.711771 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-95972390-4ad3-4664-b536-e78f9724ee7e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:51.712942 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-95972390-4ad3-4664-b536-e78f9724ee7e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:51.712942 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-95972390-4ad3-4664-b536-e78f9724ee7e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:51.713452 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-95972390-4ad3-4664-b536-e78f9724ee7e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:51.713990 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-95972390-4ad3-4664-b536-e78f9724ee7e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:51.714420 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-95972390-4ad3-4664-b536-e78f9724ee7e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:51.714795 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-6fb96889-1bc7-454a-bac8-fba2eb5542a4 req-4c4eb213-6b44-4111-9cff-b8248604570a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19e1622-6521-459d-9db1-80abd4bcf0f8", "tag": "df9e6e2c-d105-4f6a-aaf7-3619c1f5c26c"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:07:51.725944 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-6fb96889-1bc7-454a-bac8-fba2eb5542a4 req-4c4eb213-6b44-4111-9cff-b8248604570a service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:51.726519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-6fb96889-1bc7-454a-bac8-fba2eb5542a4 req-4c4eb213-6b44-4111-9cff-b8248604570a service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:51.727018 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-6fb96889-1bc7-454a-bac8-fba2eb5542a4 req-4c4eb213-6b44-4111-9cff-b8248604570a service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:51.742936 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-6fb96889-1bc7-454a-bac8-fba2eb5542a4 req-4c4eb213-6b44-4111-9cff-b8248604570a service nova] Creating event network-changed:df9e6e2c-d105-4f6a-aaf7-3619c1f5c26c for instance b19e1622-6521-459d-9db1-80abd4bcf0f8 on hv-cinder-85931 Sep 26 18:07:51.748470 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-6fb96889-1bc7-454a-bac8-fba2eb5542a4 req-4c4eb213-6b44-4111-9cff-b8248604570a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037451 Sep 26 18:07:51.749408 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 262/509] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:07:51.863178 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-95972390-4ad3-4664-b536-e78f9724ee7e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:51.868191 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c402b8d7-1125-4e3a-ba1b-071d99268e74 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:51.868894 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c402b8d7-1125-4e3a-ba1b-071d99268e74 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:51.872136 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-95972390-4ad3-4664-b536-e78f9724ee7e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1368 microversion: 2.1 time: 0.173977 Sep 26 18:07:51.872840 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 248/510] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:51 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:51.875866 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c402b8d7-1125-4e3a-ba1b-071d99268e74 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:51.876471 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c402b8d7-1125-4e3a-ba1b-071d99268e74 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:51.876916 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c402b8d7-1125-4e3a-ba1b-071d99268e74 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:51.877629 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c402b8d7-1125-4e3a-ba1b-071d99268e74 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:51.878099 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c402b8d7-1125-4e3a-ba1b-071d99268e74 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:51.878512 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c402b8d7-1125-4e3a-ba1b-071d99268e74 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:52.021302 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c402b8d7-1125-4e3a-ba1b-071d99268e74 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:52.030160 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c402b8d7-1125-4e3a-ba1b-071d99268e74 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:52.031918 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c402b8d7-1125-4e3a-ba1b-071d99268e74 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:52.033075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c402b8d7-1125-4e3a-ba1b-071d99268e74 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1744 microversion: 2.20 time: 0.169382 Sep 26 18:07:52.034545 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 263/511] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:51 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:07:52.897371 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d5f70c98-7ce4-46d0-b7de-ddaf6c1eb834 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:52.897978 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d5f70c98-7ce4-46d0-b7de-ddaf6c1eb834 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:52.904821 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d5f70c98-7ce4-46d0-b7de-ddaf6c1eb834 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:52.915838 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d5f70c98-7ce4-46d0-b7de-ddaf6c1eb834 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:52.915838 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d5f70c98-7ce4-46d0-b7de-ddaf6c1eb834 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:52.915838 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d5f70c98-7ce4-46d0-b7de-ddaf6c1eb834 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:52.915838 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d5f70c98-7ce4-46d0-b7de-ddaf6c1eb834 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:52.916231 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d5f70c98-7ce4-46d0-b7de-ddaf6c1eb834 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:52.916231 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:53.059987 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-70624f9a-588e-45bf-9e9f-34935130b8ea tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:53.060701 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-70624f9a-588e-45bf-9e9f-34935130b8ea tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:53.068699 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-70624f9a-588e-45bf-9e9f-34935130b8ea tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:53.070044 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-70624f9a-588e-45bf-9e9f-34935130b8ea tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:53.070498 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-70624f9a-588e-45bf-9e9f-34935130b8ea tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:53.071224 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-70624f9a-588e-45bf-9e9f-34935130b8ea tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:53.071882 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-70624f9a-588e-45bf-9e9f-34935130b8ea tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:53.072312 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-70624f9a-588e-45bf-9e9f-34935130b8ea tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:53.203166 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d5f70c98-7ce4-46d0-b7de-ddaf6c1eb834 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:53.210975 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d5f70c98-7ce4-46d0-b7de-ddaf6c1eb834 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1368 microversion: 2.1 time: 0.317678 Sep 26 18:07:53.211544 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 249/512] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:52 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1368 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:53.371111 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-70624f9a-588e-45bf-9e9f-34935130b8ea tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:53.380004 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-70624f9a-588e-45bf-9e9f-34935130b8ea tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:53.381452 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-70624f9a-588e-45bf-9e9f-34935130b8ea tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:53.382687 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-70624f9a-588e-45bf-9e9f-34935130b8ea tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1744 microversion: 2.20 time: 0.328048 Sep 26 18:07:53.383308 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 264/513] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:53 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1744 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:07:54.153855 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-4771bc09-376c-4f6e-a796-2122d50da104 req-2fcc5ce3-f766-49a4-9c76-aa4d0835adb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8560d88-7c26-4e3c-8af6-aac7ac9aa390", "tag": "f7bfcff1-da00-43a3-96d5-30997503c634"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:07:54.165315 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-4771bc09-376c-4f6e-a796-2122d50da104 req-2fcc5ce3-f766-49a4-9c76-aa4d0835adb8 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:54.165971 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-4771bc09-376c-4f6e-a796-2122d50da104 req-2fcc5ce3-f766-49a4-9c76-aa4d0835adb8 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:54.166591 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-4771bc09-376c-4f6e-a796-2122d50da104 req-2fcc5ce3-f766-49a4-9c76-aa4d0835adb8 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:54.178894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-4771bc09-376c-4f6e-a796-2122d50da104 req-2fcc5ce3-f766-49a4-9c76-aa4d0835adb8 service nova] Creating event network-changed:f7bfcff1-da00-43a3-96d5-30997503c634 for instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 on hv-cinder-85931 Sep 26 18:07:54.183854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-4771bc09-376c-4f6e-a796-2122d50da104 req-2fcc5ce3-f766-49a4-9c76-aa4d0835adb8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035146 Sep 26 18:07:54.184451 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 250/514] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:07:54.240064 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a1ac44f7-ac56-4f16-a456-7e491da72bc7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:54.240709 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a1ac44f7-ac56-4f16-a456-7e491da72bc7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:54.243179 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:54.248387 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1ac44f7-ac56-4f16-a456-7e491da72bc7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:54.248876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1ac44f7-ac56-4f16-a456-7e491da72bc7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:54.249320 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1ac44f7-ac56-4f16-a456-7e491da72bc7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:54.250251 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1ac44f7-ac56-4f16-a456-7e491da72bc7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:54.250977 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1ac44f7-ac56-4f16-a456-7e491da72bc7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:54.251455 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1ac44f7-ac56-4f16-a456-7e491da72bc7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:54.411860 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-5e6cd245-8802-4863-8fbd-7668e411b9c0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:54.414120 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-5e6cd245-8802-4863-8fbd-7668e411b9c0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:54.423062 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e6cd245-8802-4863-8fbd-7668e411b9c0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:54.423693 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e6cd245-8802-4863-8fbd-7668e411b9c0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:54.424872 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e6cd245-8802-4863-8fbd-7668e411b9c0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:54.425664 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e6cd245-8802-4863-8fbd-7668e411b9c0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:54.426211 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e6cd245-8802-4863-8fbd-7668e411b9c0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:54.426964 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e6cd245-8802-4863-8fbd-7668e411b9c0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:54.543208 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=12 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:54.695914 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a1ac44f7-ac56-4f16-a456-7e491da72bc7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:54.729870 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a1ac44f7-ac56-4f16-a456-7e491da72bc7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1368 microversion: 2.1 time: 0.493080 Sep 26 18:07:54.747744 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 265/515] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:54 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1368 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:54.854544 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-5e6cd245-8802-4863-8fbd-7668e411b9c0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:54.881919 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-00e48195-b23b-4712-ab38-04710a9210cd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:07:54.893786 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-00e48195-b23b-4712-ab38-04710a9210cd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:54.901800 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-5e6cd245-8802-4863-8fbd-7668e411b9c0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:54.906754 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-5e6cd245-8802-4863-8fbd-7668e411b9c0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:54.909593 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-5e6cd245-8802-4863-8fbd-7668e411b9c0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1739 microversion: 2.20 time: 0.502120 Sep 26 18:07:54.910858 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00e48195-b23b-4712-ab38-04710a9210cd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:54.911310 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 251/516] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:54 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1739 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:07:54.911503 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00e48195-b23b-4712-ab38-04710a9210cd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:54.912091 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00e48195-b23b-4712-ab38-04710a9210cd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:54.913247 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00e48195-b23b-4712-ab38-04710a9210cd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:54.914067 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00e48195-b23b-4712-ab38-04710a9210cd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:54.914512 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00e48195-b23b-4712-ab38-04710a9210cd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:54.918700 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=100 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:54.940912 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-00e48195-b23b-4712-ab38-04710a9210cd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lazy-loading 'flavor' on Instance uuid a44a359c-9109-4982-a7d2-ba4622f28fc6 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:07:55.411685 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-00e48195-b23b-4712-ab38-04710a9210cd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "POST /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/action" status: 200 len: 32 microversion: 2.1 time: 0.542141 Sep 26 18:07:55.417342 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 266/517] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Sep 26 18:07:54 2022] POST /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/action => generated 32 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 26 18:07:55.428068 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c3c60d77-48e3-4364-bc69-cad36187c9bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:55.430024 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c3c60d77-48e3-4364-bc69-cad36187c9bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:55.437353 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c3c60d77-48e3-4364-bc69-cad36187c9bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:55.438268 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c3c60d77-48e3-4364-bc69-cad36187c9bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:55.438769 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c3c60d77-48e3-4364-bc69-cad36187c9bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:55.440149 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c3c60d77-48e3-4364-bc69-cad36187c9bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:55.441123 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c3c60d77-48e3-4364-bc69-cad36187c9bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:55.442037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c3c60d77-48e3-4364-bc69-cad36187c9bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:55.520750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-573837ac-00e7-4fb3-a61a-3fcad8a13a5a req-510dd568-e3af-4d05-b803-5c278cd733a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6298d28-8cba-46d8-a809-bd0f81e18d58", "name": "network-vif-plugged", "status": "completed", "tag": "a14f5b04-fe69-47de-b23e-8ff9f06a4aae"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:07:55.533398 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-573837ac-00e7-4fb3-a61a-3fcad8a13a5a req-510dd568-e3af-4d05-b803-5c278cd733a9 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:55.533886 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-573837ac-00e7-4fb3-a61a-3fcad8a13a5a req-510dd568-e3af-4d05-b803-5c278cd733a9 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:55.534316 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-573837ac-00e7-4fb3-a61a-3fcad8a13a5a req-510dd568-e3af-4d05-b803-5c278cd733a9 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:55.554922 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-573837ac-00e7-4fb3-a61a-3fcad8a13a5a req-510dd568-e3af-4d05-b803-5c278cd733a9 service nova] Creating event network-vif-plugged:a14f5b04-fe69-47de-b23e-8ff9f06a4aae for instance f6298d28-8cba-46d8-a809-bd0f81e18d58 on hv-cinder-85931 Sep 26 18:07:55.561246 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-573837ac-00e7-4fb3-a61a-3fcad8a13a5a req-510dd568-e3af-4d05-b803-5c278cd733a9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044471 Sep 26 18:07:55.562483 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 267/518] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:07:55.684911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c3c60d77-48e3-4364-bc69-cad36187c9bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:55.734369 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c3c60d77-48e3-4364-bc69-cad36187c9bd tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.304275 Sep 26 18:07:55.734369 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 252/519] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:55 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:55.762265 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d7f20f11-ed24-4418-b2a4-d89cb1a8faf5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:55.763377 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d7f20f11-ed24-4418-b2a4-d89cb1a8faf5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:55.787627 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d7f20f11-ed24-4418-b2a4-d89cb1a8faf5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:55.788825 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d7f20f11-ed24-4418-b2a4-d89cb1a8faf5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:55.789853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d7f20f11-ed24-4418-b2a4-d89cb1a8faf5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:55.791423 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d7f20f11-ed24-4418-b2a4-d89cb1a8faf5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:55.792357 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d7f20f11-ed24-4418-b2a4-d89cb1a8faf5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:55.793235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d7f20f11-ed24-4418-b2a4-d89cb1a8faf5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:55.946921 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-7b97d098-cec1-4c26-ac3b-b67af41e602c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:55.947897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-7b97d098-cec1-4c26-ac3b-b67af41e602c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:55.966964 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7b97d098-cec1-4c26-ac3b-b67af41e602c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:55.967463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7b97d098-cec1-4c26-ac3b-b67af41e602c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:55.967923 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7b97d098-cec1-4c26-ac3b-b67af41e602c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:55.968827 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7b97d098-cec1-4c26-ac3b-b67af41e602c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:55.969283 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7b97d098-cec1-4c26-ac3b-b67af41e602c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:55.969704 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7b97d098-cec1-4c26-ac3b-b67af41e602c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:56.185692 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d7f20f11-ed24-4418-b2a4-d89cb1a8faf5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:56.195626 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d7f20f11-ed24-4418-b2a4-d89cb1a8faf5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1368 microversion: 2.1 time: 0.439122 Sep 26 18:07:56.197057 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 268/520] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:55 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1368 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:56.361899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-7b97d098-cec1-4c26-ac3b-b67af41e602c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:56.381460 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-7b97d098-cec1-4c26-ac3b-b67af41e602c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:56.384334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-7b97d098-cec1-4c26-ac3b-b67af41e602c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:56.386019 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-7b97d098-cec1-4c26-ac3b-b67af41e602c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1739 microversion: 2.20 time: 0.449726 Sep 26 18:07:56.400024 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 253/521] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:55 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1739 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:07:56.758414 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-0ce0c241-f052-4277-b505-01273c151ff4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:56.759681 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-0ce0c241-f052-4277-b505-01273c151ff4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:56.769308 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0ce0c241-f052-4277-b505-01273c151ff4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:56.772075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0ce0c241-f052-4277-b505-01273c151ff4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:56.772554 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0ce0c241-f052-4277-b505-01273c151ff4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:56.773353 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0ce0c241-f052-4277-b505-01273c151ff4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:56.773861 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0ce0c241-f052-4277-b505-01273c151ff4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:56.774285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0ce0c241-f052-4277-b505-01273c151ff4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:57.013790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-0ce0c241-f052-4277-b505-01273c151ff4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:57.026041 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-0ce0c241-f052-4277-b505-01273c151ff4 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.275429 Sep 26 18:07:57.026998 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 269/522] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:56 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:57.224413 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6be5a910-8aa6-4b05-b76f-bcca341d6d13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:57.225208 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-6be5a910-8aa6-4b05-b76f-bcca341d6d13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:57.242023 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6be5a910-8aa6-4b05-b76f-bcca341d6d13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:57.242516 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6be5a910-8aa6-4b05-b76f-bcca341d6d13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:57.242945 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6be5a910-8aa6-4b05-b76f-bcca341d6d13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:57.243671 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6be5a910-8aa6-4b05-b76f-bcca341d6d13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:57.244222 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6be5a910-8aa6-4b05-b76f-bcca341d6d13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:57.244674 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6be5a910-8aa6-4b05-b76f-bcca341d6d13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:57.414928 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-32550acf-f1ca-4c65-ab57-8e7ee90b222a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:57.417801 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-32550acf-f1ca-4c65-ab57-8e7ee90b222a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:57.423221 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-32550acf-f1ca-4c65-ab57-8e7ee90b222a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:57.423841 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-32550acf-f1ca-4c65-ab57-8e7ee90b222a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:57.424410 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-32550acf-f1ca-4c65-ab57-8e7ee90b222a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:57.425330 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-32550acf-f1ca-4c65-ab57-8e7ee90b222a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:57.425858 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-32550acf-f1ca-4c65-ab57-8e7ee90b222a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:57.426515 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-32550acf-f1ca-4c65-ab57-8e7ee90b222a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:57.439791 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6be5a910-8aa6-4b05-b76f-bcca341d6d13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:57.449576 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-6be5a910-8aa6-4b05-b76f-bcca341d6d13 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1368 microversion: 2.1 time: 0.231065 Sep 26 18:07:57.457998 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 254/523] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:57 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:57.639844 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-32550acf-f1ca-4c65-ab57-8e7ee90b222a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:57.649172 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-32550acf-f1ca-4c65-ab57-8e7ee90b222a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:57.650875 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-32550acf-f1ca-4c65-ab57-8e7ee90b222a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:57.652297 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-32550acf-f1ca-4c65-ab57-8e7ee90b222a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1739 microversion: 2.20 time: 0.241652 Sep 26 18:07:57.653119 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 270/524] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:57 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:07:58.054061 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-bc147a8c-86d1-47c6-839e-6f862a0c4d9c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:58.054681 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-bc147a8c-86d1-47c6-839e-6f862a0c4d9c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:58.066180 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc147a8c-86d1-47c6-839e-6f862a0c4d9c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:58.066680 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc147a8c-86d1-47c6-839e-6f862a0c4d9c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:58.067121 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc147a8c-86d1-47c6-839e-6f862a0c4d9c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:58.067886 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc147a8c-86d1-47c6-839e-6f862a0c4d9c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:58.068365 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc147a8c-86d1-47c6-839e-6f862a0c4d9c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:58.068798 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc147a8c-86d1-47c6-839e-6f862a0c4d9c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:58.282544 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-bc147a8c-86d1-47c6-839e-6f862a0c4d9c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:58.293851 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-bc147a8c-86d1-47c6-839e-6f862a0c4d9c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.243737 Sep 26 18:07:58.308465 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 255/525] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:58 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:58.482860 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f506356b-4af5-4d71-8067-e369eac77b17 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:58.485053 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f506356b-4af5-4d71-8067-e369eac77b17 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:58.495190 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f506356b-4af5-4d71-8067-e369eac77b17 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:58.496044 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f506356b-4af5-4d71-8067-e369eac77b17 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:58.496982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f506356b-4af5-4d71-8067-e369eac77b17 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:58.498424 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f506356b-4af5-4d71-8067-e369eac77b17 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:58.501042 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f506356b-4af5-4d71-8067-e369eac77b17 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:58.502027 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f506356b-4af5-4d71-8067-e369eac77b17 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:58.688034 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4660e96f-ea54-4300-8d86-4891a5235384 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:58.689329 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4660e96f-ea54-4300-8d86-4891a5235384 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:58.689572 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f506356b-4af5-4d71-8067-e369eac77b17 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:58.696015 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4660e96f-ea54-4300-8d86-4891a5235384 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:58.696692 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4660e96f-ea54-4300-8d86-4891a5235384 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:58.697302 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f506356b-4af5-4d71-8067-e369eac77b17 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1368 microversion: 2.1 time: 0.221626 Sep 26 18:07:58.697439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4660e96f-ea54-4300-8d86-4891a5235384 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:58.697880 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 271/526] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:58 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:07:58.698991 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4660e96f-ea54-4300-8d86-4891a5235384 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:58.699807 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4660e96f-ea54-4300-8d86-4891a5235384 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:58.702584 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4660e96f-ea54-4300-8d86-4891a5235384 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:58.862422 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-4660e96f-ea54-4300-8d86-4891a5235384 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:58.871048 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-4660e96f-ea54-4300-8d86-4891a5235384 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:58.872517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-4660e96f-ea54-4300-8d86-4891a5235384 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:58.873654 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4660e96f-ea54-4300-8d86-4891a5235384 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1739 microversion: 2.20 time: 0.190471 Sep 26 18:07:58.874213 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 256/527] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:58 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:07:59.319335 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-0b8f5f17-3f19-49ef-b95b-8cb1b3dfdb02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:59.319979 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-0b8f5f17-3f19-49ef-b95b-8cb1b3dfdb02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:59.326011 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0b8f5f17-3f19-49ef-b95b-8cb1b3dfdb02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:59.326498 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0b8f5f17-3f19-49ef-b95b-8cb1b3dfdb02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:59.326949 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0b8f5f17-3f19-49ef-b95b-8cb1b3dfdb02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:59.328366 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0b8f5f17-3f19-49ef-b95b-8cb1b3dfdb02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:59.328836 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0b8f5f17-3f19-49ef-b95b-8cb1b3dfdb02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:59.329266 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0b8f5f17-3f19-49ef-b95b-8cb1b3dfdb02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:59.498061 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-0b8f5f17-3f19-49ef-b95b-8cb1b3dfdb02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:07:59.512042 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-0b8f5f17-3f19-49ef-b95b-8cb1b3dfdb02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.195890 Sep 26 18:07:59.524275 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 272/528] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:59 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:07:59.727143 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-52a6a9ae-7121-4847-9713-ecd82c26de08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:59.728574 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-52a6a9ae-7121-4847-9713-ecd82c26de08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:59.739100 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-52a6a9ae-7121-4847-9713-ecd82c26de08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:59.739612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-52a6a9ae-7121-4847-9713-ecd82c26de08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:59.740117 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-52a6a9ae-7121-4847-9713-ecd82c26de08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:59.741099 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-52a6a9ae-7121-4847-9713-ecd82c26de08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:59.741778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-52a6a9ae-7121-4847-9713-ecd82c26de08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:59.742209 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-52a6a9ae-7121-4847-9713-ecd82c26de08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:59.910843 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f74d2890-7977-4fcd-9c1e-fd25991e9b68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:07:59.911756 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f74d2890-7977-4fcd-9c1e-fd25991e9b68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:07:59.919745 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f74d2890-7977-4fcd-9c1e-fd25991e9b68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:59.919745 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f74d2890-7977-4fcd-9c1e-fd25991e9b68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:59.920456 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f74d2890-7977-4fcd-9c1e-fd25991e9b68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:07:59.923622 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f74d2890-7977-4fcd-9c1e-fd25991e9b68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:07:59.924584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f74d2890-7977-4fcd-9c1e-fd25991e9b68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:07:59.925324 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f74d2890-7977-4fcd-9c1e-fd25991e9b68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:00.005015 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-52a6a9ae-7121-4847-9713-ecd82c26de08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:00.025293 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-52a6a9ae-7121-4847-9713-ecd82c26de08 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1368 microversion: 2.1 time: 0.302418 Sep 26 18:08:00.025993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 257/529] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:07:59 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1368 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:00.210713 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f74d2890-7977-4fcd-9c1e-fd25991e9b68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:00.222035 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f74d2890-7977-4fcd-9c1e-fd25991e9b68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:00.224217 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f74d2890-7977-4fcd-9c1e-fd25991e9b68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:00.226643 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f74d2890-7977-4fcd-9c1e-fd25991e9b68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1739 microversion: 2.20 time: 0.322153 Sep 26 18:08:00.240455 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 273/530] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:07:59 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:00.550331 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-cbf608ef-30f6-4e47-8d43-da8f2f669d20 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:00.550331 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-cbf608ef-30f6-4e47-8d43-da8f2f669d20 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:00.568176 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cbf608ef-30f6-4e47-8d43-da8f2f669d20 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:00.572615 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cbf608ef-30f6-4e47-8d43-da8f2f669d20 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:00.573272 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cbf608ef-30f6-4e47-8d43-da8f2f669d20 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:00.578525 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cbf608ef-30f6-4e47-8d43-da8f2f669d20 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:00.579148 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cbf608ef-30f6-4e47-8d43-da8f2f669d20 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:00.583695 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cbf608ef-30f6-4e47-8d43-da8f2f669d20 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:00.817155 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-cbf608ef-30f6-4e47-8d43-da8f2f669d20 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:00.835302 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-cbf608ef-30f6-4e47-8d43-da8f2f669d20 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.301480 Sep 26 18:08:00.835923 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 258/531] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:00 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:01.058547 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-6c4d7f4e-4d3f-48c0-a629-5e664eba39d2 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:01.059180 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-6c4d7f4e-4d3f-48c0-a629-5e664eba39d2 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:01.070378 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6c4d7f4e-4d3f-48c0-a629-5e664eba39d2 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:01.071187 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6c4d7f4e-4d3f-48c0-a629-5e664eba39d2 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:01.071849 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6c4d7f4e-4d3f-48c0-a629-5e664eba39d2 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:01.072748 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6c4d7f4e-4d3f-48c0-a629-5e664eba39d2 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:01.073376 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6c4d7f4e-4d3f-48c0-a629-5e664eba39d2 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:01.074000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6c4d7f4e-4d3f-48c0-a629-5e664eba39d2 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:01.263371 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d454fc28-91dd-4a02-bfee-8ed5fc63b3af tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:01.266748 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d454fc28-91dd-4a02-bfee-8ed5fc63b3af tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:01.273756 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d454fc28-91dd-4a02-bfee-8ed5fc63b3af tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:01.274687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d454fc28-91dd-4a02-bfee-8ed5fc63b3af tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:01.275344 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d454fc28-91dd-4a02-bfee-8ed5fc63b3af tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:01.276485 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d454fc28-91dd-4a02-bfee-8ed5fc63b3af tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:01.277124 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d454fc28-91dd-4a02-bfee-8ed5fc63b3af tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:01.277711 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d454fc28-91dd-4a02-bfee-8ed5fc63b3af tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:01.288139 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-6c4d7f4e-4d3f-48c0-a629-5e664eba39d2 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:01.301046 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-6c4d7f4e-4d3f-48c0-a629-5e664eba39d2 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1368 microversion: 2.1 time: 0.246261 Sep 26 18:08:01.311692 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 274/532] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:01 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:01.493757 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d454fc28-91dd-4a02-bfee-8ed5fc63b3af tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:01.522289 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d454fc28-91dd-4a02-bfee-8ed5fc63b3af tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:01.522289 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d454fc28-91dd-4a02-bfee-8ed5fc63b3af tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:01.522289 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d454fc28-91dd-4a02-bfee-8ed5fc63b3af tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1739 microversion: 2.20 time: 0.268812 Sep 26 18:08:01.523501 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 259/533] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:01 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:01.860951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5e0ec1a7-f9bf-4072-879d-1de0c8b7560b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:01.861745 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-5e0ec1a7-f9bf-4072-879d-1de0c8b7560b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:01.874989 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5e0ec1a7-f9bf-4072-879d-1de0c8b7560b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:01.879358 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5e0ec1a7-f9bf-4072-879d-1de0c8b7560b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:01.881679 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5e0ec1a7-f9bf-4072-879d-1de0c8b7560b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:01.882768 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5e0ec1a7-f9bf-4072-879d-1de0c8b7560b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:01.884118 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5e0ec1a7-f9bf-4072-879d-1de0c8b7560b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:01.887478 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5e0ec1a7-f9bf-4072-879d-1de0c8b7560b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:02.107771 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5e0ec1a7-f9bf-4072-879d-1de0c8b7560b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:02.121412 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5e0ec1a7-f9bf-4072-879d-1de0c8b7560b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.265568 Sep 26 18:08:02.122886 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 275/534] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:01 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:02.185301 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-4ab707b8-ad3b-4a12-a618-94dea82a19c8 req-a2e2d2f0-5127-4ac2-83d6-5e1fa617b6cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8560d88-7c26-4e3c-8af6-aac7ac9aa390", "name": "network-vif-plugged", "status": "completed", "tag": "f7bfcff1-da00-43a3-96d5-30997503c634"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:02.206283 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-4ab707b8-ad3b-4a12-a618-94dea82a19c8 req-a2e2d2f0-5127-4ac2-83d6-5e1fa617b6cd service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:02.207740 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-4ab707b8-ad3b-4a12-a618-94dea82a19c8 req-a2e2d2f0-5127-4ac2-83d6-5e1fa617b6cd service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:02.209949 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-4ab707b8-ad3b-4a12-a618-94dea82a19c8 req-a2e2d2f0-5127-4ac2-83d6-5e1fa617b6cd service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:02.234412 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-4ab707b8-ad3b-4a12-a618-94dea82a19c8 req-a2e2d2f0-5127-4ac2-83d6-5e1fa617b6cd service nova] Creating event network-vif-plugged:f7bfcff1-da00-43a3-96d5-30997503c634 for instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 on hv-cinder-85931 Sep 26 18:08:02.240123 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-4ab707b8-ad3b-4a12-a618-94dea82a19c8 req-a2e2d2f0-5127-4ac2-83d6-5e1fa617b6cd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058543 Sep 26 18:08:02.241161 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 260/535] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:08:02.330465 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-64a15f12-f79f-45fa-b5ca-d612e61967e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:02.331901 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-64a15f12-f79f-45fa-b5ca-d612e61967e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:02.344112 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64a15f12-f79f-45fa-b5ca-d612e61967e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:02.346605 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64a15f12-f79f-45fa-b5ca-d612e61967e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:02.347394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64a15f12-f79f-45fa-b5ca-d612e61967e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:02.348769 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64a15f12-f79f-45fa-b5ca-d612e61967e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:02.349430 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64a15f12-f79f-45fa-b5ca-d612e61967e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:02.352002 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-64a15f12-f79f-45fa-b5ca-d612e61967e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:02.526676 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-64a15f12-f79f-45fa-b5ca-d612e61967e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:02.537991 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-64a15f12-f79f-45fa-b5ca-d612e61967e9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1368 microversion: 2.1 time: 0.211966 Sep 26 18:08:02.538782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 276/536] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:02 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:02.554410 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c140c33e-9a37-4784-89a7-f6aecc7f148b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:02.555811 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c140c33e-9a37-4784-89a7-f6aecc7f148b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:02.570365 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c140c33e-9a37-4784-89a7-f6aecc7f148b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:02.570855 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c140c33e-9a37-4784-89a7-f6aecc7f148b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:02.571352 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c140c33e-9a37-4784-89a7-f6aecc7f148b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:02.572598 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c140c33e-9a37-4784-89a7-f6aecc7f148b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:02.572598 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c140c33e-9a37-4784-89a7-f6aecc7f148b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:02.573913 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c140c33e-9a37-4784-89a7-f6aecc7f148b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:03.076761 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c140c33e-9a37-4784-89a7-f6aecc7f148b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:03.076761 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c140c33e-9a37-4784-89a7-f6aecc7f148b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:03.079165 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c140c33e-9a37-4784-89a7-f6aecc7f148b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:03.079165 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c140c33e-9a37-4784-89a7-f6aecc7f148b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1739 microversion: 2.20 time: 0.302369 Sep 26 18:08:03.079165 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 261/537] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:02 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1739 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:03.149511 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-dd89db28-ecc1-4e01-bc21-7d8d897f29fe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:03.150413 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-dd89db28-ecc1-4e01-bc21-7d8d897f29fe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:03.157089 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dd89db28-ecc1-4e01-bc21-7d8d897f29fe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:03.157583 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dd89db28-ecc1-4e01-bc21-7d8d897f29fe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:03.158023 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dd89db28-ecc1-4e01-bc21-7d8d897f29fe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:03.158728 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dd89db28-ecc1-4e01-bc21-7d8d897f29fe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:03.159188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dd89db28-ecc1-4e01-bc21-7d8d897f29fe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:03.159618 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dd89db28-ecc1-4e01-bc21-7d8d897f29fe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:03.310273 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-dd89db28-ecc1-4e01-bc21-7d8d897f29fe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:03.326035 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-dd89db28-ecc1-4e01-bc21-7d8d897f29fe tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.180211 Sep 26 18:08:03.326845 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 277/538] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:03 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:03.573344 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2be480da-8375-464f-93bb-3dd47f49b693 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:03.574373 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2be480da-8375-464f-93bb-3dd47f49b693 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:03.583725 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2be480da-8375-464f-93bb-3dd47f49b693 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:03.585432 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2be480da-8375-464f-93bb-3dd47f49b693 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:03.587049 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2be480da-8375-464f-93bb-3dd47f49b693 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:03.588317 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2be480da-8375-464f-93bb-3dd47f49b693 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:03.589071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2be480da-8375-464f-93bb-3dd47f49b693 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:03.589878 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2be480da-8375-464f-93bb-3dd47f49b693 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:03.792998 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2be480da-8375-464f-93bb-3dd47f49b693 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:03.805345 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2be480da-8375-464f-93bb-3dd47f49b693 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1368 microversion: 2.1 time: 0.241759 Sep 26 18:08:03.808339 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 262/539] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:03 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:04.038068 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a5c69f5e-21d1-42f7-a7d4-66e863eceacf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:04.038670 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a5c69f5e-21d1-42f7-a7d4-66e863eceacf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:04.049575 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a5c69f5e-21d1-42f7-a7d4-66e863eceacf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:04.050379 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a5c69f5e-21d1-42f7-a7d4-66e863eceacf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:04.051000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a5c69f5e-21d1-42f7-a7d4-66e863eceacf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:04.051919 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a5c69f5e-21d1-42f7-a7d4-66e863eceacf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:04.052552 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a5c69f5e-21d1-42f7-a7d4-66e863eceacf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:04.053133 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a5c69f5e-21d1-42f7-a7d4-66e863eceacf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:04.252316 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a5c69f5e-21d1-42f7-a7d4-66e863eceacf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:04.281560 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a5c69f5e-21d1-42f7-a7d4-66e863eceacf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:04.285105 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a5c69f5e-21d1-42f7-a7d4-66e863eceacf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:04.287388 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a5c69f5e-21d1-42f7-a7d4-66e863eceacf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1739 microversion: 2.20 time: 0.253656 Sep 26 18:08:04.288698 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 278/540] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:04 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:08:04.360626 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6372212c-797b-46a3-8eee-c35a15536249 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:04.361631 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-6372212c-797b-46a3-8eee-c35a15536249 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:04.369257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6372212c-797b-46a3-8eee-c35a15536249 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:04.370027 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6372212c-797b-46a3-8eee-c35a15536249 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:04.370520 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6372212c-797b-46a3-8eee-c35a15536249 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:04.371274 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6372212c-797b-46a3-8eee-c35a15536249 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:04.371762 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6372212c-797b-46a3-8eee-c35a15536249 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:04.372266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6372212c-797b-46a3-8eee-c35a15536249 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:04.566909 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6372212c-797b-46a3-8eee-c35a15536249 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:04.587606 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-6372212c-797b-46a3-8eee-c35a15536249 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.231573 Sep 26 18:08:04.596941 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 263/541] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:04 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:04.836238 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-67b78c72-8242-440c-8fe2-b5f5ab5574f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:04.836809 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-67b78c72-8242-440c-8fe2-b5f5ab5574f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:04.844358 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-67b78c72-8242-440c-8fe2-b5f5ab5574f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:04.845018 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-67b78c72-8242-440c-8fe2-b5f5ab5574f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:04.845461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-67b78c72-8242-440c-8fe2-b5f5ab5574f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:04.846176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-67b78c72-8242-440c-8fe2-b5f5ab5574f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:04.846635 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-67b78c72-8242-440c-8fe2-b5f5ab5574f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:04.847063 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-67b78c72-8242-440c-8fe2-b5f5ab5574f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:05.065761 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-67b78c72-8242-440c-8fe2-b5f5ab5574f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:05.082233 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-67b78c72-8242-440c-8fe2-b5f5ab5574f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1368 microversion: 2.1 time: 0.250802 Sep 26 18:08:05.082988 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 279/542] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:04 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:05.324841 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1f97c176-95c1-41c2-a200-0b513b6414b9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:05.325428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1f97c176-95c1-41c2-a200-0b513b6414b9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:05.332526 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1f97c176-95c1-41c2-a200-0b513b6414b9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:05.333331 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1f97c176-95c1-41c2-a200-0b513b6414b9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:05.334045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1f97c176-95c1-41c2-a200-0b513b6414b9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:05.335177 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1f97c176-95c1-41c2-a200-0b513b6414b9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:05.335993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1f97c176-95c1-41c2-a200-0b513b6414b9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:05.336704 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1f97c176-95c1-41c2-a200-0b513b6414b9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:05.569892 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1f97c176-95c1-41c2-a200-0b513b6414b9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:05.585024 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1f97c176-95c1-41c2-a200-0b513b6414b9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:05.588305 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1f97c176-95c1-41c2-a200-0b513b6414b9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:05.591759 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1f97c176-95c1-41c2-a200-0b513b6414b9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1739 microversion: 2.20 time: 0.270575 Sep 26 18:08:05.608292 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 264/543] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:05 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1739 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:05.623943 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a3bcdad2-3874-41f4-90b3-329ffc404165 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:05.626020 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a3bcdad2-3874-41f4-90b3-329ffc404165 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:05.636289 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a3bcdad2-3874-41f4-90b3-329ffc404165 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:05.636766 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a3bcdad2-3874-41f4-90b3-329ffc404165 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:05.637280 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a3bcdad2-3874-41f4-90b3-329ffc404165 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:05.638340 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a3bcdad2-3874-41f4-90b3-329ffc404165 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:05.638858 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a3bcdad2-3874-41f4-90b3-329ffc404165 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:05.639283 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a3bcdad2-3874-41f4-90b3-329ffc404165 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:05.884269 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a3bcdad2-3874-41f4-90b3-329ffc404165 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:05.897993 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a3bcdad2-3874-41f4-90b3-329ffc404165 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.279423 Sep 26 18:08:05.898899 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 280/544] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:05 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:06.114114 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-49892205-7fd1-454a-9b18-fb3a72b7e00e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:06.115597 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-49892205-7fd1-454a-9b18-fb3a72b7e00e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:06.131865 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49892205-7fd1-454a-9b18-fb3a72b7e00e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:06.132423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49892205-7fd1-454a-9b18-fb3a72b7e00e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:06.132915 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49892205-7fd1-454a-9b18-fb3a72b7e00e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:06.133700 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49892205-7fd1-454a-9b18-fb3a72b7e00e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:06.134203 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49892205-7fd1-454a-9b18-fb3a72b7e00e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:06.134679 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49892205-7fd1-454a-9b18-fb3a72b7e00e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:06.319590 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-49892205-7fd1-454a-9b18-fb3a72b7e00e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:06.330685 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-49892205-7fd1-454a-9b18-fb3a72b7e00e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1559 microversion: 2.1 time: 0.221634 Sep 26 18:08:06.331283 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 265/545] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:06 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:06.355171 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b26147f5-9e4a-41fa-8e35-0ba84d51fdd5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:06.355688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b26147f5-9e4a-41fa-8e35-0ba84d51fdd5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:06.363078 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b26147f5-9e4a-41fa-8e35-0ba84d51fdd5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:06.363580 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b26147f5-9e4a-41fa-8e35-0ba84d51fdd5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:06.364050 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b26147f5-9e4a-41fa-8e35-0ba84d51fdd5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:06.364782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b26147f5-9e4a-41fa-8e35-0ba84d51fdd5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:06.365245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b26147f5-9e4a-41fa-8e35-0ba84d51fdd5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:06.365675 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b26147f5-9e4a-41fa-8e35-0ba84d51fdd5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:06.386360 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:06.459227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b26147f5-9e4a-41fa-8e35-0ba84d51fdd5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107884 Sep 26 18:08:06.459968 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 281/546] 10.222.0.67 () {58 vars in 1275 bytes} [Mon Sep 26 18:08:06 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:08:06.624794 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-dac54fca-db86-4978-8e17-309f0b6f6fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:06.625662 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-dac54fca-db86-4978-8e17-309f0b6f6fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:06.637484 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dac54fca-db86-4978-8e17-309f0b6f6fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:06.639696 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dac54fca-db86-4978-8e17-309f0b6f6fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:06.639696 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dac54fca-db86-4978-8e17-309f0b6f6fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:06.639696 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dac54fca-db86-4978-8e17-309f0b6f6fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:06.640570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dac54fca-db86-4978-8e17-309f0b6f6fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:06.640851 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dac54fca-db86-4978-8e17-309f0b6f6fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:06.885560 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-dac54fca-db86-4978-8e17-309f0b6f6fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:06.895519 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-dac54fca-db86-4978-8e17-309f0b6f6fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:06.897025 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-dac54fca-db86-4978-8e17-309f0b6f6fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:06.898181 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-dac54fca-db86-4978-8e17-309f0b6f6fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1739 microversion: 2.20 time: 0.278009 Sep 26 18:08:06.898747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 266/547] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:06 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:06.924944 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-24559528-2e4e-4664-867b-0784835b7216 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:06.925564 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-24559528-2e4e-4664-867b-0784835b7216 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:06.929122 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:06.938901 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-24559528-2e4e-4664-867b-0784835b7216 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:06.939422 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-24559528-2e4e-4664-867b-0784835b7216 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:06.939906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-24559528-2e4e-4664-867b-0784835b7216 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:06.940614 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-24559528-2e4e-4664-867b-0784835b7216 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:06.941289 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-24559528-2e4e-4664-867b-0784835b7216 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:06.941717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-24559528-2e4e-4664-867b-0784835b7216 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:07.164353 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-24559528-2e4e-4664-867b-0784835b7216 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:07.173729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-24559528-2e4e-4664-867b-0784835b7216 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.254043 Sep 26 18:08:07.174308 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 282/548] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:06 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:07.856164 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-2da6cc8c-5a3d-4e01-bbb0-29afe99ce7f6 req-195df524-a728-4643-9cd4-1e9169460a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8560d88-7c26-4e3c-8af6-aac7ac9aa390", "tag": "f7bfcff1-da00-43a3-96d5-30997503c634"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:07.872660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-2da6cc8c-5a3d-4e01-bbb0-29afe99ce7f6 req-195df524-a728-4643-9cd4-1e9169460a92 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:07.873789 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-2da6cc8c-5a3d-4e01-bbb0-29afe99ce7f6 req-195df524-a728-4643-9cd4-1e9169460a92 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:07.874673 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-2da6cc8c-5a3d-4e01-bbb0-29afe99ce7f6 req-195df524-a728-4643-9cd4-1e9169460a92 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:07.886430 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=100 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:07.889258 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-2da6cc8c-5a3d-4e01-bbb0-29afe99ce7f6 req-195df524-a728-4643-9cd4-1e9169460a92 service nova] Creating event network-changed:f7bfcff1-da00-43a3-96d5-30997503c634 for instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 on hv-cinder-85931 Sep 26 18:08:07.901151 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-2da6cc8c-5a3d-4e01-bbb0-29afe99ce7f6 req-195df524-a728-4643-9cd4-1e9169460a92 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044031 Sep 26 18:08:07.901151 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 267/549] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:08:07.931078 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-6dfdc68d-536d-4692-8a1c-62c5d5e0e61f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:07.932396 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-6dfdc68d-536d-4692-8a1c-62c5d5e0e61f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:07.939746 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6dfdc68d-536d-4692-8a1c-62c5d5e0e61f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:07.940437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6dfdc68d-536d-4692-8a1c-62c5d5e0e61f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:07.941077 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6dfdc68d-536d-4692-8a1c-62c5d5e0e61f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:07.943095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6dfdc68d-536d-4692-8a1c-62c5d5e0e61f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:07.943095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6dfdc68d-536d-4692-8a1c-62c5d5e0e61f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:07.943095 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6dfdc68d-536d-4692-8a1c-62c5d5e0e61f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:08.198968 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f9f4abab-026e-4949-b3a8-36fd1795c8cb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:08.199961 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f9f4abab-026e-4949-b3a8-36fd1795c8cb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:08.211105 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9f4abab-026e-4949-b3a8-36fd1795c8cb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:08.211434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-6dfdc68d-536d-4692-8a1c-62c5d5e0e61f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:08.212101 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9f4abab-026e-4949-b3a8-36fd1795c8cb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:08.212757 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9f4abab-026e-4949-b3a8-36fd1795c8cb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:08.213612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9f4abab-026e-4949-b3a8-36fd1795c8cb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:08.214264 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9f4abab-026e-4949-b3a8-36fd1795c8cb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:08.214876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9f4abab-026e-4949-b3a8-36fd1795c8cb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:08.223880 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-6dfdc68d-536d-4692-8a1c-62c5d5e0e61f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:08.229972 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-6dfdc68d-536d-4692-8a1c-62c5d5e0e61f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:08.231481 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-6dfdc68d-536d-4692-8a1c-62c5d5e0e61f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1739 microversion: 2.20 time: 0.304481 Sep 26 18:08:08.232260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 283/550] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:07 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:08.521421 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f9f4abab-026e-4949-b3a8-36fd1795c8cb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:08.532118 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f9f4abab-026e-4949-b3a8-36fd1795c8cb tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.337349 Sep 26 18:08:08.541368 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 268/551] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:08 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:09.260952 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-71aa17ad-dc8f-4394-8068-92897ca2c775 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:09.261589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-71aa17ad-dc8f-4394-8068-92897ca2c775 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:09.273133 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71aa17ad-dc8f-4394-8068-92897ca2c775 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:09.273133 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71aa17ad-dc8f-4394-8068-92897ca2c775 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:09.275635 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71aa17ad-dc8f-4394-8068-92897ca2c775 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:09.275635 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71aa17ad-dc8f-4394-8068-92897ca2c775 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:09.275635 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71aa17ad-dc8f-4394-8068-92897ca2c775 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:09.275635 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-71aa17ad-dc8f-4394-8068-92897ca2c775 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:09.557542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-5a25daaf-a837-41fb-ac8b-bacbb6b96592 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:09.558122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-5a25daaf-a837-41fb-ac8b-bacbb6b96592 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:09.566233 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5a25daaf-a837-41fb-ac8b-bacbb6b96592 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:09.566721 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5a25daaf-a837-41fb-ac8b-bacbb6b96592 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:09.567154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5a25daaf-a837-41fb-ac8b-bacbb6b96592 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:09.568066 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5a25daaf-a837-41fb-ac8b-bacbb6b96592 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:09.568708 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5a25daaf-a837-41fb-ac8b-bacbb6b96592 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:09.569195 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5a25daaf-a837-41fb-ac8b-bacbb6b96592 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:09.795014 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-71aa17ad-dc8f-4394-8068-92897ca2c775 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:09.804748 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-71aa17ad-dc8f-4394-8068-92897ca2c775 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:09.807537 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-71aa17ad-dc8f-4394-8068-92897ca2c775 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:09.809261 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-5a25daaf-a837-41fb-ac8b-bacbb6b96592 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:09.809616 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-71aa17ad-dc8f-4394-8068-92897ca2c775 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1739 microversion: 2.20 time: 0.552315 Sep 26 18:08:09.810545 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 284/552] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:09 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1739 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:09.825639 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-5a25daaf-a837-41fb-ac8b-bacbb6b96592 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.273115 Sep 26 18:08:09.841961 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 269/553] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:09 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:10.853198 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-68ffc69d-1f4a-4889-ace0-21d2d94ff7f6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:10.853996 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-68ffc69d-1f4a-4889-ace0-21d2d94ff7f6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:10.860497 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-5b98c536-bdf5-48e2-9a2c-1b2fd4534df0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:10.861206 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-68ffc69d-1f4a-4889-ace0-21d2d94ff7f6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:10.861357 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-5b98c536-bdf5-48e2-9a2c-1b2fd4534df0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:10.861518 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-68ffc69d-1f4a-4889-ace0-21d2d94ff7f6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:10.861813 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-68ffc69d-1f4a-4889-ace0-21d2d94ff7f6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:10.862513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-68ffc69d-1f4a-4889-ace0-21d2d94ff7f6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:10.863060 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-68ffc69d-1f4a-4889-ace0-21d2d94ff7f6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:10.863493 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-68ffc69d-1f4a-4889-ace0-21d2d94ff7f6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:10.871923 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5b98c536-bdf5-48e2-9a2c-1b2fd4534df0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:10.872752 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5b98c536-bdf5-48e2-9a2c-1b2fd4534df0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:10.873548 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5b98c536-bdf5-48e2-9a2c-1b2fd4534df0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:10.874586 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5b98c536-bdf5-48e2-9a2c-1b2fd4534df0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:10.875424 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5b98c536-bdf5-48e2-9a2c-1b2fd4534df0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:10.876100 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5b98c536-bdf5-48e2-9a2c-1b2fd4534df0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:11.085398 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-68ffc69d-1f4a-4889-ace0-21d2d94ff7f6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:11.092252 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-5b98c536-bdf5-48e2-9a2c-1b2fd4534df0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:11.094455 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-68ffc69d-1f4a-4889-ace0-21d2d94ff7f6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:11.095936 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-68ffc69d-1f4a-4889-ace0-21d2d94ff7f6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:11.097104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-68ffc69d-1f4a-4889-ace0-21d2d94ff7f6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1721 microversion: 2.20 time: 0.248053 Sep 26 18:08:11.097656 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 285/554] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:10 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:11.104697 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-5b98c536-bdf5-48e2-9a2c-1b2fd4534df0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.249685 Sep 26 18:08:11.105191 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 270/555] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:10 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:11.990376 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-d020167e-b46c-4cb0-98d2-602a1da4658a req-12e2268c-3109-461a-9381-c48f0e1b1704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6298d28-8cba-46d8-a809-bd0f81e18d58", "name": "network-vif-unplugged", "status": "completed", "tag": "a14f5b04-fe69-47de-b23e-8ff9f06a4aae"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:12.003898 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-d020167e-b46c-4cb0-98d2-602a1da4658a req-12e2268c-3109-461a-9381-c48f0e1b1704 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:12.004380 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-d020167e-b46c-4cb0-98d2-602a1da4658a req-12e2268c-3109-461a-9381-c48f0e1b1704 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:12.004807 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-d020167e-b46c-4cb0-98d2-602a1da4658a req-12e2268c-3109-461a-9381-c48f0e1b1704 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:12.021096 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-d020167e-b46c-4cb0-98d2-602a1da4658a req-12e2268c-3109-461a-9381-c48f0e1b1704 service nova] Creating event network-vif-unplugged:a14f5b04-fe69-47de-b23e-8ff9f06a4aae for instance f6298d28-8cba-46d8-a809-bd0f81e18d58 on hv-cinder-85931 Sep 26 18:08:12.031072 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-d020167e-b46c-4cb0-98d2-602a1da4658a req-12e2268c-3109-461a-9381-c48f0e1b1704 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047987 Sep 26 18:08:12.032157 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 286/556] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:08:12.125468 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-0af46bae-8533-4eb3-8636-dfbc93f220bb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:12.126320 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-0af46bae-8533-4eb3-8636-dfbc93f220bb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:12.128422 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-2e7a8fb2-f86a-420f-bf51-07fba1011f91 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:12.129162 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-2e7a8fb2-f86a-420f-bf51-07fba1011f91 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:12.135896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2e7a8fb2-f86a-420f-bf51-07fba1011f91 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:12.136339 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0af46bae-8533-4eb3-8636-dfbc93f220bb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:12.136482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2e7a8fb2-f86a-420f-bf51-07fba1011f91 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:12.136819 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2e7a8fb2-f86a-420f-bf51-07fba1011f91 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:12.137141 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0af46bae-8533-4eb3-8636-dfbc93f220bb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:12.137523 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2e7a8fb2-f86a-420f-bf51-07fba1011f91 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:12.137861 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0af46bae-8533-4eb3-8636-dfbc93f220bb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:12.138029 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2e7a8fb2-f86a-420f-bf51-07fba1011f91 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:12.138923 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2e7a8fb2-f86a-420f-bf51-07fba1011f91 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:12.139482 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0af46bae-8533-4eb3-8636-dfbc93f220bb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:12.140811 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0af46bae-8533-4eb3-8636-dfbc93f220bb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:12.141477 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0af46bae-8533-4eb3-8636-dfbc93f220bb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:12.357679 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-2e7a8fb2-f86a-420f-bf51-07fba1011f91 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:12.361614 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-0af46bae-8533-4eb3-8636-dfbc93f220bb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:12.367084 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-2e7a8fb2-f86a-420f-bf51-07fba1011f91 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.243804 Sep 26 18:08:12.367679 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 287/557] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:12 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:12.370209 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-0af46bae-8533-4eb3-8636-dfbc93f220bb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:12.371641 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-0af46bae-8533-4eb3-8636-dfbc93f220bb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:12.372803 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-0af46bae-8533-4eb3-8636-dfbc93f220bb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1721 microversion: 2.20 time: 0.252871 Sep 26 18:08:12.373344 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 271/558] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:12 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:08:13.392496 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-4b30c8fb-852b-4b44-9794-ac6132870908 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:13.393181 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-4b30c8fb-852b-4b44-9794-ac6132870908 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:13.399969 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b30c8fb-852b-4b44-9794-ac6132870908 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:13.400457 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b30c8fb-852b-4b44-9794-ac6132870908 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:13.404076 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b30c8fb-852b-4b44-9794-ac6132870908 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:13.404285 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-cd9d501a-875b-45b0-864b-95ce310ee747 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:13.405025 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b30c8fb-852b-4b44-9794-ac6132870908 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:13.405172 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-cd9d501a-875b-45b0-864b-95ce310ee747 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:13.406268 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b30c8fb-852b-4b44-9794-ac6132870908 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:13.406268 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b30c8fb-852b-4b44-9794-ac6132870908 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:13.409455 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cd9d501a-875b-45b0-864b-95ce310ee747 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:13.410017 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cd9d501a-875b-45b0-864b-95ce310ee747 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:13.410393 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cd9d501a-875b-45b0-864b-95ce310ee747 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:13.411097 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cd9d501a-875b-45b0-864b-95ce310ee747 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:13.411680 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cd9d501a-875b-45b0-864b-95ce310ee747 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:13.412118 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cd9d501a-875b-45b0-864b-95ce310ee747 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:13.825878 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-4b30c8fb-852b-4b44-9794-ac6132870908 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:13.836593 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-4b30c8fb-852b-4b44-9794-ac6132870908 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.449543 Sep 26 18:08:13.837580 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 288/559] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:13 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:13.852747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-cd9d501a-875b-45b0-864b-95ce310ee747 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:13.863003 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-cd9d501a-875b-45b0-864b-95ce310ee747 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:13.864978 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-cd9d501a-875b-45b0-864b-95ce310ee747 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:13.866160 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-cd9d501a-875b-45b0-864b-95ce310ee747 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1724 microversion: 2.20 time: 0.468994 Sep 26 18:08:13.866751 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 272/560] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:13 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1724 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:08:13.892763 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-51585a9c-6d6d-4051-8de3-228512afb7c7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f70e362b-24c6-48f8-bb22-865e6b949c3d"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:13.896015 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-51585a9c-6d6d-4051-8de3-228512afb7c7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:13.907294 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-51585a9c-6d6d-4051-8de3-228512afb7c7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:13.908380 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-51585a9c-6d6d-4051-8de3-228512afb7c7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:13.909279 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-51585a9c-6d6d-4051-8de3-228512afb7c7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:13.911234 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-51585a9c-6d6d-4051-8de3-228512afb7c7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:13.912083 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-51585a9c-6d6d-4051-8de3-228512afb7c7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:13.912871 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-51585a9c-6d6d-4051-8de3-228512afb7c7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:14.865757 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e6a83df6-2d64-4b08-a6fe-4a8b79dd1632 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:14.866515 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e6a83df6-2d64-4b08-a6fe-4a8b79dd1632 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:14.873468 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e6a83df6-2d64-4b08-a6fe-4a8b79dd1632 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:14.873985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e6a83df6-2d64-4b08-a6fe-4a8b79dd1632 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:14.881102 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e6a83df6-2d64-4b08-a6fe-4a8b79dd1632 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:14.881102 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e6a83df6-2d64-4b08-a6fe-4a8b79dd1632 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:14.881102 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e6a83df6-2d64-4b08-a6fe-4a8b79dd1632 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:14.881102 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e6a83df6-2d64-4b08-a6fe-4a8b79dd1632 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:15.034485 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e6a83df6-2d64-4b08-a6fe-4a8b79dd1632 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:15.043033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e6a83df6-2d64-4b08-a6fe-4a8b79dd1632 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.181516 Sep 26 18:08:15.043615 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 273/561] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:14 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:15.403017 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-51585a9c-6d6d-4051-8de3-228512afb7c7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "POST /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.515173 Sep 26 18:08:15.403882 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 289/562] 10.222.0.67 () {62 vars in 1364 bytes} [Mon Sep 26 18:08:13 2022] POST /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/os-volume_attachments => generated 188 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 18:08:15.546682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e14e17e1-2c04-4088-b35f-5f1d3e5ec7cd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:15.547226 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e14e17e1-2c04-4088-b35f-5f1d3e5ec7cd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:15.553355 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e14e17e1-2c04-4088-b35f-5f1d3e5ec7cd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:15.554007 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e14e17e1-2c04-4088-b35f-5f1d3e5ec7cd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:15.554284 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e14e17e1-2c04-4088-b35f-5f1d3e5ec7cd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:15.555014 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e14e17e1-2c04-4088-b35f-5f1d3e5ec7cd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:15.555471 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e14e17e1-2c04-4088-b35f-5f1d3e5ec7cd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:15.555922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e14e17e1-2c04-4088-b35f-5f1d3e5ec7cd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:15.602790 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e14e17e1-2c04-4088-b35f-5f1d3e5ec7cd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121028) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 18:08:16.027826 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e14e17e1-2c04-4088-b35f-5f1d3e5ec7cd tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "POST /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/action" status: 202 len: 0 microversion: 2.20 time: 0.485790 Sep 26 18:08:16.028864 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 274/563] 10.222.0.67 () {62 vars in 1319 bytes} [Mon Sep 26 18:08:15 2022] POST /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:08:16.037374 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-756a3f4d-e645-48a0-abda-02bd12cd815e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:16.038384 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-756a3f4d-e645-48a0-abda-02bd12cd815e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:16.047569 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-756a3f4d-e645-48a0-abda-02bd12cd815e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:16.048364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-756a3f4d-e645-48a0-abda-02bd12cd815e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:16.048814 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-756a3f4d-e645-48a0-abda-02bd12cd815e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:16.049554 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-756a3f4d-e645-48a0-abda-02bd12cd815e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:16.050030 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-756a3f4d-e645-48a0-abda-02bd12cd815e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:16.050457 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-756a3f4d-e645-48a0-abda-02bd12cd815e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:16.070223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ceef2c29-9c94-46fb-9294-078273de30d9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:16.070863 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ceef2c29-9c94-46fb-9294-078273de30d9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:16.077220 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ceef2c29-9c94-46fb-9294-078273de30d9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:16.078164 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ceef2c29-9c94-46fb-9294-078273de30d9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:16.078679 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ceef2c29-9c94-46fb-9294-078273de30d9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:16.079557 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ceef2c29-9c94-46fb-9294-078273de30d9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:16.080115 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ceef2c29-9c94-46fb-9294-078273de30d9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:16.080824 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ceef2c29-9c94-46fb-9294-078273de30d9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:16.319885 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-756a3f4d-e645-48a0-abda-02bd12cd815e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:16.329092 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ceef2c29-9c94-46fb-9294-078273de30d9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:16.332653 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-756a3f4d-e645-48a0-abda-02bd12cd815e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:16.334182 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-756a3f4d-e645-48a0-abda-02bd12cd815e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:16.335400 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-756a3f4d-e645-48a0-abda-02bd12cd815e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1750 microversion: 2.20 time: 0.302364 Sep 26 18:08:16.335992 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 290/564] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:16 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1750 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:16.349256 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ceef2c29-9c94-46fb-9294-078273de30d9 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1734 microversion: 2.1 time: 0.283006 Sep 26 18:08:16.350716 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 275/565] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:16 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1734 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:17.373346 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c0d1a09d-adc4-4849-a7ef-715f15a5b995 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:17.374521 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c0d1a09d-adc4-4849-a7ef-715f15a5b995 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:17.382275 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c0d1a09d-adc4-4849-a7ef-715f15a5b995 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:17.383158 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c0d1a09d-adc4-4849-a7ef-715f15a5b995 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:17.383801 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c0d1a09d-adc4-4849-a7ef-715f15a5b995 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:17.384060 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-38214bb4-e0f3-4d07-926c-000af033d31e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:17.384686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-38214bb4-e0f3-4d07-926c-000af033d31e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:17.385587 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c0d1a09d-adc4-4849-a7ef-715f15a5b995 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:17.386202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c0d1a09d-adc4-4849-a7ef-715f15a5b995 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:17.386782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c0d1a09d-adc4-4849-a7ef-715f15a5b995 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:17.392167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38214bb4-e0f3-4d07-926c-000af033d31e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:17.392669 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38214bb4-e0f3-4d07-926c-000af033d31e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:17.393108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38214bb4-e0f3-4d07-926c-000af033d31e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:17.393819 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38214bb4-e0f3-4d07-926c-000af033d31e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:17.394278 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38214bb4-e0f3-4d07-926c-000af033d31e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:17.394710 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38214bb4-e0f3-4d07-926c-000af033d31e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:17.627002 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c0d1a09d-adc4-4849-a7ef-715f15a5b995 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:17.628210 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-38214bb4-e0f3-4d07-926c-000af033d31e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:17.637998 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-38214bb4-e0f3-4d07-926c-000af033d31e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1714 microversion: 2.1 time: 0.257619 Sep 26 18:08:17.638947 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 276/566] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:17 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1714 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:17.644448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c0d1a09d-adc4-4849-a7ef-715f15a5b995 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:17.645910 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c0d1a09d-adc4-4849-a7ef-715f15a5b995 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:17.647173 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c0d1a09d-adc4-4849-a7ef-715f15a5b995 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1750 microversion: 2.20 time: 0.278784 Sep 26 18:08:17.658646 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 291/567] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:17 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1750 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:08:17.771620 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-251cd170-7278-471e-809e-0e4a0af9c5f5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:17.772136 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-251cd170-7278-471e-809e-0e4a0af9c5f5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:17.778044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-251cd170-7278-471e-809e-0e4a0af9c5f5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:17.778523 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-251cd170-7278-471e-809e-0e4a0af9c5f5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:17.778954 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-251cd170-7278-471e-809e-0e4a0af9c5f5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:17.779675 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-251cd170-7278-471e-809e-0e4a0af9c5f5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:17.780124 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-251cd170-7278-471e-809e-0e4a0af9c5f5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:17.785046 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-251cd170-7278-471e-809e-0e4a0af9c5f5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:17.912308 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-251cd170-7278-471e-809e-0e4a0af9c5f5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] HTTP exception thrown: Cannot 'detach_volume' instance a44a359c-9109-4982-a7d2-ba4622f28fc6 while it is in vm_state rescued Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-251cd170-7278-471e-809e-0e4a0af9c5f5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Request method failure captured: Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: DELETE /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-volume_attachments/7e2f368f-d3ce-48e4-b1e3-4efa15e1f1a1 HTTP/1.1 Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMelx-ipjEriwiSD7ibs9Z44BoWfZT3uyXwYPCzZ4uCB7LTqLOGaMmSnH6oOKtZayloye70yYnWFt5iXYcqgw8QZ2-eCL-Wz0unSbrK1_8M_uOgP8VNfV8jd2_jG5Mc5Zpq0az6KYot6uehZzTvsSYbg58zlBHSF8YA06MR56ri3H5AQ Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 3a15ebd862054a64ac1d739db5adc3a2 Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1906646791 Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:08:17.913911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:08:17.918386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:08:17.918386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1906646791 Sep 26 18:08:17.918386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 3a15ebd862054a64ac1d739db5adc3a2 Sep 26 18:08:17.918386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1906646791 Sep 26 18:08:17.918386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-ServerRescueNegativeTestJSON-1906646791-project Sep 26 18:08:17.918386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:08:17.918386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:08:17.918386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 97ed136f68c540abbdaf04cbe34a682e Sep 26 18:08:17.918386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1906646791-project Sep 26 18:08:17.918386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:08:17.918386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Cannot 'detach_volume' instance a44a359c-9109-4982-a7d2-ba4622f28fc6 while it is in vm_state rescued Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'server_id': 'a44a359c-9109-4982-a7d2-ba4622f28fc6', 'id': '7e2f368f-d3ce-48e4-b1e3-4efa15e1f1a1'} Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a44a359c-9109-4982-a7d2-ba4622f28fc6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:08:17.919625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:08:17.921402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 26 18:08:17.921402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 26 18:08:17.921402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 26 18:08:17.921402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 26 18:08:17.921402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a44a359c-9109-4982-a7d2-ba4622f28fc6 while it is in vm_state rescued Sep 26 18:08:17.921402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:08:17.921402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:08:17.921402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:08:17.921402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:08:17.921402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:08:17.921402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:08:17.921402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:08:17.921402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:08:17.921402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a44a359c-9109-4982-a7d2-ba4622f28fc6 while it is in vm_state rescued Sep 26 18:08:17.921402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:08:17.921402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-251cd170-7278-471e-809e-0e4a0af9c5f5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Returning 409 to user: Cannot 'detach_volume' instance a44a359c-9109-4982-a7d2-ba4622f28fc6 while it is in vm_state rescued {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:08:17.923886 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-251cd170-7278-471e-809e-0e4a0af9c5f5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-volume_attachments/7e2f368f-d3ce-48e4-b1e3-4efa15e1f1a1" status: 409 len: 152 microversion: 2.1 time: 0.147716 Sep 26 18:08:17.923886 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 277/568] 10.222.0.67 () {58 vars in 1416 bytes} [Mon Sep 26 18:08:17 2022] DELETE /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-volume_attachments/7e2f368f-d3ce-48e4-b1e3-4efa15e1f1a1 => generated 152 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 26 18:08:17.929508 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d86e6a71-b605-4a1f-a52b-9e5a73abb29c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:17.930037 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d86e6a71-b605-4a1f-a52b-9e5a73abb29c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:17.935938 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d86e6a71-b605-4a1f-a52b-9e5a73abb29c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:17.936423 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d86e6a71-b605-4a1f-a52b-9e5a73abb29c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:17.937108 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d86e6a71-b605-4a1f-a52b-9e5a73abb29c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:17.937710 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d86e6a71-b605-4a1f-a52b-9e5a73abb29c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:17.938163 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d86e6a71-b605-4a1f-a52b-9e5a73abb29c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:17.938582 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d86e6a71-b605-4a1f-a52b-9e5a73abb29c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:18.288973 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d86e6a71-b605-4a1f-a52b-9e5a73abb29c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "POST /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/action" status: 202 len: 0 microversion: 2.1 time: 0.363166 Sep 26 18:08:18.289606 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 292/569] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Sep 26 18:08:17 2022] POST /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:08:18.298423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-75cf8024-ce84-48c9-a484-6295dc2eb91f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:18.299024 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-75cf8024-ce84-48c9-a484-6295dc2eb91f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:18.306405 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75cf8024-ce84-48c9-a484-6295dc2eb91f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:18.306618 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75cf8024-ce84-48c9-a484-6295dc2eb91f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:18.307176 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75cf8024-ce84-48c9-a484-6295dc2eb91f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:18.307884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75cf8024-ce84-48c9-a484-6295dc2eb91f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:18.308347 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75cf8024-ce84-48c9-a484-6295dc2eb91f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:18.308805 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75cf8024-ce84-48c9-a484-6295dc2eb91f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:18.461617 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-75cf8024-ce84-48c9-a484-6295dc2eb91f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:18.470962 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-75cf8024-ce84-48c9-a484-6295dc2eb91f tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1722 microversion: 2.1 time: 0.176894 Sep 26 18:08:18.473935 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 278/570] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:18 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:18.684830 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f9dc00ee-8919-4ddd-b5f8-005b2b6519a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:18.685528 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f9dc00ee-8919-4ddd-b5f8-005b2b6519a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:18.693188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f9dc00ee-8919-4ddd-b5f8-005b2b6519a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:18.693672 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f9dc00ee-8919-4ddd-b5f8-005b2b6519a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:18.694112 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f9dc00ee-8919-4ddd-b5f8-005b2b6519a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:18.694801 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f9dc00ee-8919-4ddd-b5f8-005b2b6519a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:18.695258 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f9dc00ee-8919-4ddd-b5f8-005b2b6519a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:18.695716 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f9dc00ee-8919-4ddd-b5f8-005b2b6519a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:18.839053 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f9dc00ee-8919-4ddd-b5f8-005b2b6519a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:18.848483 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f9dc00ee-8919-4ddd-b5f8-005b2b6519a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:18.849964 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f9dc00ee-8919-4ddd-b5f8-005b2b6519a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:18.851133 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f9dc00ee-8919-4ddd-b5f8-005b2b6519a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1752 microversion: 2.20 time: 0.170653 Sep 26 18:08:18.851698 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 293/571] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:18 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:19.494402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-52e5820b-4d9b-4b34-977c-0e49c839d7a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:19.495007 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-52e5820b-4d9b-4b34-977c-0e49c839d7a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:19.502427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-52e5820b-4d9b-4b34-977c-0e49c839d7a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:19.510690 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-52e5820b-4d9b-4b34-977c-0e49c839d7a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:19.510690 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-52e5820b-4d9b-4b34-977c-0e49c839d7a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:19.510690 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-52e5820b-4d9b-4b34-977c-0e49c839d7a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:19.510690 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-52e5820b-4d9b-4b34-977c-0e49c839d7a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:19.511085 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-52e5820b-4d9b-4b34-977c-0e49c839d7a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:19.637890 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-52e5820b-4d9b-4b34-977c-0e49c839d7a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:19.646645 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-52e5820b-4d9b-4b34-977c-0e49c839d7a5 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1722 microversion: 2.1 time: 0.156092 Sep 26 18:08:19.647202 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 279/572] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:19 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:19.879250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b62e9e5b-a3cb-4aaf-959b-305270896377 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:19.884177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b62e9e5b-a3cb-4aaf-959b-305270896377 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:19.886537 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b62e9e5b-a3cb-4aaf-959b-305270896377 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:19.887014 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b62e9e5b-a3cb-4aaf-959b-305270896377 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:19.887443 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b62e9e5b-a3cb-4aaf-959b-305270896377 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:19.888158 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b62e9e5b-a3cb-4aaf-959b-305270896377 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:19.888873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b62e9e5b-a3cb-4aaf-959b-305270896377 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:19.889292 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b62e9e5b-a3cb-4aaf-959b-305270896377 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:20.028997 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b62e9e5b-a3cb-4aaf-959b-305270896377 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:20.038956 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b62e9e5b-a3cb-4aaf-959b-305270896377 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:20.040529 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b62e9e5b-a3cb-4aaf-959b-305270896377 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:20.041792 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b62e9e5b-a3cb-4aaf-959b-305270896377 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1752 microversion: 2.20 time: 0.167483 Sep 26 18:08:20.042380 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 294/573] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:19 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:20.670337 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-512c7dec-ce34-4c26-98cd-d60ff70f4644 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:20.670957 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-512c7dec-ce34-4c26-98cd-d60ff70f4644 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:20.673636 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:20.678615 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-512c7dec-ce34-4c26-98cd-d60ff70f4644 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:20.679127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-512c7dec-ce34-4c26-98cd-d60ff70f4644 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:20.679563 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-512c7dec-ce34-4c26-98cd-d60ff70f4644 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:20.680368 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-512c7dec-ce34-4c26-98cd-d60ff70f4644 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:20.680822 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-512c7dec-ce34-4c26-98cd-d60ff70f4644 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:20.681247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-512c7dec-ce34-4c26-98cd-d60ff70f4644 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:20.820997 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-512c7dec-ce34-4c26-98cd-d60ff70f4644 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:20.830135 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-512c7dec-ce34-4c26-98cd-d60ff70f4644 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1722 microversion: 2.1 time: 0.163730 Sep 26 18:08:20.830712 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 280/574] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:20 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:21.069380 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a2e5196d-1b1c-400c-8be0-0762c26f45b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:21.069961 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a2e5196d-1b1c-400c-8be0-0762c26f45b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:21.076694 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a2e5196d-1b1c-400c-8be0-0762c26f45b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:21.077223 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a2e5196d-1b1c-400c-8be0-0762c26f45b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:21.078177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a2e5196d-1b1c-400c-8be0-0762c26f45b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:21.079015 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a2e5196d-1b1c-400c-8be0-0762c26f45b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:21.079466 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a2e5196d-1b1c-400c-8be0-0762c26f45b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:21.079911 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a2e5196d-1b1c-400c-8be0-0762c26f45b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:21.099200 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:21.216824 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a2e5196d-1b1c-400c-8be0-0762c26f45b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:21.225326 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a2e5196d-1b1c-400c-8be0-0762c26f45b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:21.226756 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a2e5196d-1b1c-400c-8be0-0762c26f45b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:21.228111 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a2e5196d-1b1c-400c-8be0-0762c26f45b1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1752 microversion: 2.20 time: 0.162575 Sep 26 18:08:21.228653 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 295/575] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:21 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:21.860667 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3a9f3308-ba36-4c05-8190-c0e9c9cdd290 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:21.861441 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-3a9f3308-ba36-4c05-8190-c0e9c9cdd290 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:21.868483 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3a9f3308-ba36-4c05-8190-c0e9c9cdd290 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:21.868965 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3a9f3308-ba36-4c05-8190-c0e9c9cdd290 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:21.869395 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3a9f3308-ba36-4c05-8190-c0e9c9cdd290 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:21.870141 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3a9f3308-ba36-4c05-8190-c0e9c9cdd290 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:21.870591 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3a9f3308-ba36-4c05-8190-c0e9c9cdd290 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:21.871010 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3a9f3308-ba36-4c05-8190-c0e9c9cdd290 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:22.007041 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3a9f3308-ba36-4c05-8190-c0e9c9cdd290 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:22.016172 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-3a9f3308-ba36-4c05-8190-c0e9c9cdd290 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1722 microversion: 2.1 time: 0.159293 Sep 26 18:08:22.016732 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 281/576] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:21 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:08:22.254662 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9846c2bb-a11c-4065-abf1-9ea274c510cf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:22.255192 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9846c2bb-a11c-4065-abf1-9ea274c510cf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:22.261868 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9846c2bb-a11c-4065-abf1-9ea274c510cf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:22.262349 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9846c2bb-a11c-4065-abf1-9ea274c510cf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:22.262780 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9846c2bb-a11c-4065-abf1-9ea274c510cf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:22.263767 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9846c2bb-a11c-4065-abf1-9ea274c510cf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:22.264456 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9846c2bb-a11c-4065-abf1-9ea274c510cf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:22.264790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9846c2bb-a11c-4065-abf1-9ea274c510cf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:22.405243 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9846c2bb-a11c-4065-abf1-9ea274c510cf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:22.416423 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9846c2bb-a11c-4065-abf1-9ea274c510cf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:22.417849 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9846c2bb-a11c-4065-abf1-9ea274c510cf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:22.419021 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9846c2bb-a11c-4065-abf1-9ea274c510cf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1752 microversion: 2.20 time: 0.168354 Sep 26 18:08:22.419581 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 296/577] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:22 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:23.040493 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8caf3471-8974-4f4d-a753-6ef54745de52 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:23.041086 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-8caf3471-8974-4f4d-a753-6ef54745de52 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:23.054678 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8caf3471-8974-4f4d-a753-6ef54745de52 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:23.055202 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8caf3471-8974-4f4d-a753-6ef54745de52 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:23.058709 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8caf3471-8974-4f4d-a753-6ef54745de52 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:23.058709 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8caf3471-8974-4f4d-a753-6ef54745de52 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:23.058709 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8caf3471-8974-4f4d-a753-6ef54745de52 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:23.058709 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8caf3471-8974-4f4d-a753-6ef54745de52 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:23.203598 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8caf3471-8974-4f4d-a753-6ef54745de52 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:23.212223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8caf3471-8974-4f4d-a753-6ef54745de52 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1728 microversion: 2.1 time: 0.175580 Sep 26 18:08:23.223798 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 282/578] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:08:23 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:08:23.237468 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f8b7b6ac-9ee4-44ab-b76f-189c3314cb0e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:23.238001 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f8b7b6ac-9ee4-44ab-b76f-189c3314cb0e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:23.244695 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8b7b6ac-9ee4-44ab-b76f-189c3314cb0e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:23.245180 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8b7b6ac-9ee4-44ab-b76f-189c3314cb0e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:23.245608 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8b7b6ac-9ee4-44ab-b76f-189c3314cb0e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:23.246298 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8b7b6ac-9ee4-44ab-b76f-189c3314cb0e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:23.246799 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8b7b6ac-9ee4-44ab-b76f-189c3314cb0e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:23.247387 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8b7b6ac-9ee4-44ab-b76f-189c3314cb0e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:23.331864 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f8b7b6ac-9ee4-44ab-b76f-189c3314cb0e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099156 Sep 26 18:08:23.333148 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 297/579] 10.222.0.67 () {58 vars in 1275 bytes} [Mon Sep 26 18:08:23 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:08:23.446407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9d59292c-53c5-440b-8f59-57414b4d4a68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:23.447176 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9d59292c-53c5-440b-8f59-57414b4d4a68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:23.453862 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d59292c-53c5-440b-8f59-57414b4d4a68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:23.454372 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d59292c-53c5-440b-8f59-57414b4d4a68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:23.454801 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d59292c-53c5-440b-8f59-57414b4d4a68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:23.455486 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d59292c-53c5-440b-8f59-57414b4d4a68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:23.455985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d59292c-53c5-440b-8f59-57414b4d4a68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:23.456391 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d59292c-53c5-440b-8f59-57414b4d4a68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:23.475134 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:23.596189 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9d59292c-53c5-440b-8f59-57414b4d4a68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:23.604936 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9d59292c-53c5-440b-8f59-57414b4d4a68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:23.606372 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9d59292c-53c5-440b-8f59-57414b4d4a68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:23.607524 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9d59292c-53c5-440b-8f59-57414b4d4a68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.165094 Sep 26 18:08:23.608123 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 283/580] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:23 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:24.399591 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-26b1d873-0f4f-4f52-ad6a-6fb5da683d2b req-fe82a2a7-e5f0-4068-ade4-ffa98630898c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a44a359c-9109-4982-a7d2-ba4622f28fc6", "tag": "9e6b89b3-2f73-4b79-94eb-c77bfe00bb5a"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:24.421327 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-26b1d873-0f4f-4f52-ad6a-6fb5da683d2b req-fe82a2a7-e5f0-4068-ade4-ffa98630898c service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:24.421899 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-26b1d873-0f4f-4f52-ad6a-6fb5da683d2b req-fe82a2a7-e5f0-4068-ade4-ffa98630898c service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:24.422323 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-26b1d873-0f4f-4f52-ad6a-6fb5da683d2b req-fe82a2a7-e5f0-4068-ade4-ffa98630898c service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:24.435860 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-26b1d873-0f4f-4f52-ad6a-6fb5da683d2b req-fe82a2a7-e5f0-4068-ade4-ffa98630898c service nova] Creating event network-changed:9e6b89b3-2f73-4b79-94eb-c77bfe00bb5a for instance a44a359c-9109-4982-a7d2-ba4622f28fc6 on hv-cinder-85931 Sep 26 18:08:24.442351 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-26b1d873-0f4f-4f52-ad6a-6fb5da683d2b req-fe82a2a7-e5f0-4068-ade4-ffa98630898c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048266 Sep 26 18:08:24.442956 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 298/581] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:08:24.634557 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2ff650b2-baf7-4dcc-8cb5-4de8bddf012a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:24.636324 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2ff650b2-baf7-4dcc-8cb5-4de8bddf012a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:24.644753 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2ff650b2-baf7-4dcc-8cb5-4de8bddf012a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:24.645668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2ff650b2-baf7-4dcc-8cb5-4de8bddf012a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:24.646114 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2ff650b2-baf7-4dcc-8cb5-4de8bddf012a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:24.647015 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2ff650b2-baf7-4dcc-8cb5-4de8bddf012a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:24.647523 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2ff650b2-baf7-4dcc-8cb5-4de8bddf012a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:24.648010 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2ff650b2-baf7-4dcc-8cb5-4de8bddf012a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:24.805920 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2ff650b2-baf7-4dcc-8cb5-4de8bddf012a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:24.817530 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2ff650b2-baf7-4dcc-8cb5-4de8bddf012a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:24.819056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2ff650b2-baf7-4dcc-8cb5-4de8bddf012a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:24.820256 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2ff650b2-baf7-4dcc-8cb5-4de8bddf012a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.190327 Sep 26 18:08:24.820812 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 284/582] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:24 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:25.850715 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5f195f22-868c-4560-9d29-7e00db742e93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:25.852099 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-5f195f22-868c-4560-9d29-7e00db742e93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:25.859127 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5f195f22-868c-4560-9d29-7e00db742e93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:25.860032 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5f195f22-868c-4560-9d29-7e00db742e93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:25.860629 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5f195f22-868c-4560-9d29-7e00db742e93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:25.861505 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5f195f22-868c-4560-9d29-7e00db742e93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:25.862122 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5f195f22-868c-4560-9d29-7e00db742e93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:25.862915 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5f195f22-868c-4560-9d29-7e00db742e93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:26.036146 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5f195f22-868c-4560-9d29-7e00db742e93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:26.045624 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5f195f22-868c-4560-9d29-7e00db742e93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:26.048259 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5f195f22-868c-4560-9d29-7e00db742e93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:26.049766 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5f195f22-868c-4560-9d29-7e00db742e93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.204514 Sep 26 18:08:26.050461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 299/583] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:25 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:26.461056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-ef27f1db-d9d0-40b2-87f2-f23ca8ed81a7 req-e3bbf8f4-7258-45a6-ad6b-2b2138b7a47f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a44a359c-9109-4982-a7d2-ba4622f28fc6", "tag": "9e6b89b3-2f73-4b79-94eb-c77bfe00bb5a"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:26.472885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-ef27f1db-d9d0-40b2-87f2-f23ca8ed81a7 req-e3bbf8f4-7258-45a6-ad6b-2b2138b7a47f service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:26.478431 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-ef27f1db-d9d0-40b2-87f2-f23ca8ed81a7 req-e3bbf8f4-7258-45a6-ad6b-2b2138b7a47f service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:26.478431 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-ef27f1db-d9d0-40b2-87f2-f23ca8ed81a7 req-e3bbf8f4-7258-45a6-ad6b-2b2138b7a47f service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:26.495904 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-ef27f1db-d9d0-40b2-87f2-f23ca8ed81a7 req-e3bbf8f4-7258-45a6-ad6b-2b2138b7a47f service nova] Creating event network-changed:9e6b89b3-2f73-4b79-94eb-c77bfe00bb5a for instance a44a359c-9109-4982-a7d2-ba4622f28fc6 on hv-cinder-85931 Sep 26 18:08:26.501939 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-ef27f1db-d9d0-40b2-87f2-f23ca8ed81a7 req-e3bbf8f4-7258-45a6-ad6b-2b2138b7a47f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044681 Sep 26 18:08:26.502798 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 285/584] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:08:27.078584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-56d8e5b5-8eaa-438e-89fc-34ad4b270d79 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:27.079321 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-56d8e5b5-8eaa-438e-89fc-34ad4b270d79 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:27.086072 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-56d8e5b5-8eaa-438e-89fc-34ad4b270d79 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:27.086562 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-56d8e5b5-8eaa-438e-89fc-34ad4b270d79 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:27.086996 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-56d8e5b5-8eaa-438e-89fc-34ad4b270d79 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:27.087847 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-56d8e5b5-8eaa-438e-89fc-34ad4b270d79 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:27.091976 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-56d8e5b5-8eaa-438e-89fc-34ad4b270d79 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:27.092469 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-56d8e5b5-8eaa-438e-89fc-34ad4b270d79 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:27.266819 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-56d8e5b5-8eaa-438e-89fc-34ad4b270d79 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:27.276480 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-56d8e5b5-8eaa-438e-89fc-34ad4b270d79 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:27.277988 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-56d8e5b5-8eaa-438e-89fc-34ad4b270d79 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:27.279161 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-56d8e5b5-8eaa-438e-89fc-34ad4b270d79 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.205262 Sep 26 18:08:27.279743 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 300/585] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:27 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:28.307086 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-123bb58d-5406-43c7-aa4e-780e6009fdb7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:28.307845 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-123bb58d-5406-43c7-aa4e-780e6009fdb7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:28.314751 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-123bb58d-5406-43c7-aa4e-780e6009fdb7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:28.315239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-123bb58d-5406-43c7-aa4e-780e6009fdb7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:28.315707 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-123bb58d-5406-43c7-aa4e-780e6009fdb7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:28.316407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-123bb58d-5406-43c7-aa4e-780e6009fdb7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:28.316865 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-123bb58d-5406-43c7-aa4e-780e6009fdb7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:28.317295 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-123bb58d-5406-43c7-aa4e-780e6009fdb7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:28.461925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-123bb58d-5406-43c7-aa4e-780e6009fdb7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:28.471025 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-123bb58d-5406-43c7-aa4e-780e6009fdb7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:28.472475 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-123bb58d-5406-43c7-aa4e-780e6009fdb7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:28.473627 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-123bb58d-5406-43c7-aa4e-780e6009fdb7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.171592 Sep 26 18:08:28.474181 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 286/586] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:28 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:29.500659 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-3d819cf9-58d4-464f-9308-1c3c424ea59c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:29.501385 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3d819cf9-58d4-464f-9308-1c3c424ea59c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:29.508420 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3d819cf9-58d4-464f-9308-1c3c424ea59c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:29.508904 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3d819cf9-58d4-464f-9308-1c3c424ea59c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:29.509338 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3d819cf9-58d4-464f-9308-1c3c424ea59c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:29.510039 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3d819cf9-58d4-464f-9308-1c3c424ea59c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:29.510494 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3d819cf9-58d4-464f-9308-1c3c424ea59c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:29.511047 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3d819cf9-58d4-464f-9308-1c3c424ea59c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:29.664487 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3d819cf9-58d4-464f-9308-1c3c424ea59c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:29.677133 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3d819cf9-58d4-464f-9308-1c3c424ea59c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:29.678698 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3d819cf9-58d4-464f-9308-1c3c424ea59c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:29.679992 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-3d819cf9-58d4-464f-9308-1c3c424ea59c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.184155 Sep 26 18:08:29.681896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 301/587] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:29 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:30.711435 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3e68e732-5510-4e30-aa73-86fad0fb9b7a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:30.713098 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-3e68e732-5510-4e30-aa73-86fad0fb9b7a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:30.720923 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3e68e732-5510-4e30-aa73-86fad0fb9b7a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:30.721555 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3e68e732-5510-4e30-aa73-86fad0fb9b7a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:30.722063 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3e68e732-5510-4e30-aa73-86fad0fb9b7a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:30.722839 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3e68e732-5510-4e30-aa73-86fad0fb9b7a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:30.723372 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3e68e732-5510-4e30-aa73-86fad0fb9b7a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:30.723905 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3e68e732-5510-4e30-aa73-86fad0fb9b7a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:30.862789 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3e68e732-5510-4e30-aa73-86fad0fb9b7a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:30.871950 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3e68e732-5510-4e30-aa73-86fad0fb9b7a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:30.874966 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3e68e732-5510-4e30-aa73-86fad0fb9b7a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:30.876450 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-3e68e732-5510-4e30-aa73-86fad0fb9b7a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.170239 Sep 26 18:08:30.883727 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 287/588] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:30 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:31.902438 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1a07a295-5f12-4356-960d-c3e6478b0998 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:31.903043 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1a07a295-5f12-4356-960d-c3e6478b0998 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:31.910364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1a07a295-5f12-4356-960d-c3e6478b0998 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:31.910848 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1a07a295-5f12-4356-960d-c3e6478b0998 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:31.911281 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1a07a295-5f12-4356-960d-c3e6478b0998 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:31.912063 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1a07a295-5f12-4356-960d-c3e6478b0998 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:31.912520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1a07a295-5f12-4356-960d-c3e6478b0998 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:31.912937 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1a07a295-5f12-4356-960d-c3e6478b0998 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:32.062099 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1a07a295-5f12-4356-960d-c3e6478b0998 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:32.071684 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1a07a295-5f12-4356-960d-c3e6478b0998 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:32.073380 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1a07a295-5f12-4356-960d-c3e6478b0998 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:32.075977 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1a07a295-5f12-4356-960d-c3e6478b0998 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.177481 Sep 26 18:08:32.076901 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 302/589] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:31 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:33.103037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-236586ec-a1eb-4193-b2cf-94c0e678908d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:33.103866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-236586ec-a1eb-4193-b2cf-94c0e678908d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:33.110897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-236586ec-a1eb-4193-b2cf-94c0e678908d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:33.111377 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-236586ec-a1eb-4193-b2cf-94c0e678908d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:33.114585 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-236586ec-a1eb-4193-b2cf-94c0e678908d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:33.114585 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-236586ec-a1eb-4193-b2cf-94c0e678908d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:33.114585 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-236586ec-a1eb-4193-b2cf-94c0e678908d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:33.114585 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-236586ec-a1eb-4193-b2cf-94c0e678908d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:33.259738 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-236586ec-a1eb-4193-b2cf-94c0e678908d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:33.271842 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-236586ec-a1eb-4193-b2cf-94c0e678908d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:33.273331 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-236586ec-a1eb-4193-b2cf-94c0e678908d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:33.274533 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-236586ec-a1eb-4193-b2cf-94c0e678908d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.175564 Sep 26 18:08:33.275088 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 288/590] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:33 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:34.301388 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ffe2ee85-833f-4a1c-b256-165ebaca0a14 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:34.332097 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ffe2ee85-833f-4a1c-b256-165ebaca0a14 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:34.332097 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ffe2ee85-833f-4a1c-b256-165ebaca0a14 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:34.332097 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ffe2ee85-833f-4a1c-b256-165ebaca0a14 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:34.332097 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ffe2ee85-833f-4a1c-b256-165ebaca0a14 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:34.332515 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ffe2ee85-833f-4a1c-b256-165ebaca0a14 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:34.332515 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ffe2ee85-833f-4a1c-b256-165ebaca0a14 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:34.332515 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ffe2ee85-833f-4a1c-b256-165ebaca0a14 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:34.488962 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ffe2ee85-833f-4a1c-b256-165ebaca0a14 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:34.498202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ffe2ee85-833f-4a1c-b256-165ebaca0a14 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:34.500362 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ffe2ee85-833f-4a1c-b256-165ebaca0a14 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:34.508615 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ffe2ee85-833f-4a1c-b256-165ebaca0a14 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.204495 Sep 26 18:08:34.511118 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 303/591] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:34 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:35.530551 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6d510fc6-1662-46f8-8cf4-d7079f20164b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:35.531141 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-6d510fc6-1662-46f8-8cf4-d7079f20164b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:35.538181 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d510fc6-1662-46f8-8cf4-d7079f20164b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:35.540509 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d510fc6-1662-46f8-8cf4-d7079f20164b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:35.540509 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d510fc6-1662-46f8-8cf4-d7079f20164b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:35.540509 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d510fc6-1662-46f8-8cf4-d7079f20164b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:35.540509 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d510fc6-1662-46f8-8cf4-d7079f20164b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:35.540885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d510fc6-1662-46f8-8cf4-d7079f20164b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:35.697172 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6d510fc6-1662-46f8-8cf4-d7079f20164b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:35.707168 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6d510fc6-1662-46f8-8cf4-d7079f20164b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:35.709433 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6d510fc6-1662-46f8-8cf4-d7079f20164b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:35.710996 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-6d510fc6-1662-46f8-8cf4-d7079f20164b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.185203 Sep 26 18:08:35.711840 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 289/592] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:35 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:36.740145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b7dd4f90-24bf-464b-a069-9bbcbfed1523 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:36.740752 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b7dd4f90-24bf-464b-a069-9bbcbfed1523 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:36.748867 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b7dd4f90-24bf-464b-a069-9bbcbfed1523 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:36.749350 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b7dd4f90-24bf-464b-a069-9bbcbfed1523 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:36.749779 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b7dd4f90-24bf-464b-a069-9bbcbfed1523 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:36.750463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b7dd4f90-24bf-464b-a069-9bbcbfed1523 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:36.750915 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b7dd4f90-24bf-464b-a069-9bbcbfed1523 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:36.751341 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b7dd4f90-24bf-464b-a069-9bbcbfed1523 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:36.926849 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b7dd4f90-24bf-464b-a069-9bbcbfed1523 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:36.935633 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b7dd4f90-24bf-464b-a069-9bbcbfed1523 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:36.937110 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b7dd4f90-24bf-464b-a069-9bbcbfed1523 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:36.938367 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b7dd4f90-24bf-464b-a069-9bbcbfed1523 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.202708 Sep 26 18:08:36.939138 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 304/593] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:36 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:37.965665 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a66bd7ee-7e20-489a-bb89-3d2629c39f6e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:37.966259 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a66bd7ee-7e20-489a-bb89-3d2629c39f6e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:37.972613 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a66bd7ee-7e20-489a-bb89-3d2629c39f6e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:37.973106 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a66bd7ee-7e20-489a-bb89-3d2629c39f6e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:37.973527 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a66bd7ee-7e20-489a-bb89-3d2629c39f6e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:37.974220 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a66bd7ee-7e20-489a-bb89-3d2629c39f6e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:37.974667 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a66bd7ee-7e20-489a-bb89-3d2629c39f6e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:37.975094 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a66bd7ee-7e20-489a-bb89-3d2629c39f6e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:38.121105 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a66bd7ee-7e20-489a-bb89-3d2629c39f6e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:38.131027 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a66bd7ee-7e20-489a-bb89-3d2629c39f6e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:38.132509 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a66bd7ee-7e20-489a-bb89-3d2629c39f6e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:38.133758 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a66bd7ee-7e20-489a-bb89-3d2629c39f6e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.171954 Sep 26 18:08:38.134328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 290/594] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:37 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:39.161111 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-3474bfa1-1ffb-4087-b094-896b88796047 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:39.161757 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3474bfa1-1ffb-4087-b094-896b88796047 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:39.164327 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=45 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:39.169404 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3474bfa1-1ffb-4087-b094-896b88796047 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:39.169886 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3474bfa1-1ffb-4087-b094-896b88796047 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:39.170319 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3474bfa1-1ffb-4087-b094-896b88796047 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:39.171078 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3474bfa1-1ffb-4087-b094-896b88796047 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:39.171533 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3474bfa1-1ffb-4087-b094-896b88796047 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:39.172034 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3474bfa1-1ffb-4087-b094-896b88796047 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:39.307598 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3474bfa1-1ffb-4087-b094-896b88796047 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:39.316732 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3474bfa1-1ffb-4087-b094-896b88796047 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:39.318176 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3474bfa1-1ffb-4087-b094-896b88796047 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:39.319332 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-3474bfa1-1ffb-4087-b094-896b88796047 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.163506 Sep 26 18:08:39.319930 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 305/595] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:39 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:40.346697 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-0f442f75-b069-4234-af37-92f9accc22da tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:40.347624 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-0f442f75-b069-4234-af37-92f9accc22da tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:40.354517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0f442f75-b069-4234-af37-92f9accc22da tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:40.355058 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0f442f75-b069-4234-af37-92f9accc22da tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:40.355607 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0f442f75-b069-4234-af37-92f9accc22da tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:40.356383 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0f442f75-b069-4234-af37-92f9accc22da tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:40.356933 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0f442f75-b069-4234-af37-92f9accc22da tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:40.357400 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0f442f75-b069-4234-af37-92f9accc22da tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:40.523952 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-0f442f75-b069-4234-af37-92f9accc22da tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:40.533356 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-0f442f75-b069-4234-af37-92f9accc22da tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:40.535834 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-0f442f75-b069-4234-af37-92f9accc22da tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:40.537071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-0f442f75-b069-4234-af37-92f9accc22da tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.194684 Sep 26 18:08:40.537630 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 291/596] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:40 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:41.563524 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-930c7e23-cb0d-409b-b7bb-d345b48c8777 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:41.564092 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-930c7e23-cb0d-409b-b7bb-d345b48c8777 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:41.570652 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-930c7e23-cb0d-409b-b7bb-d345b48c8777 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:41.571177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-930c7e23-cb0d-409b-b7bb-d345b48c8777 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:41.571604 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-930c7e23-cb0d-409b-b7bb-d345b48c8777 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:41.572320 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-930c7e23-cb0d-409b-b7bb-d345b48c8777 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:41.572774 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-930c7e23-cb0d-409b-b7bb-d345b48c8777 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:41.573190 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-930c7e23-cb0d-409b-b7bb-d345b48c8777 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:41.979193 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-930c7e23-cb0d-409b-b7bb-d345b48c8777 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:41.989329 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-930c7e23-cb0d-409b-b7bb-d345b48c8777 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:41.990765 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-930c7e23-cb0d-409b-b7bb-d345b48c8777 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:41.991947 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-930c7e23-cb0d-409b-b7bb-d345b48c8777 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.432409 Sep 26 18:08:41.992500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 306/597] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:41 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:43.018626 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-819de52c-bf49-490e-bdaf-eb6e63e28f78 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:43.019546 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-819de52c-bf49-490e-bdaf-eb6e63e28f78 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:43.025985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-819de52c-bf49-490e-bdaf-eb6e63e28f78 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:43.026458 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-819de52c-bf49-490e-bdaf-eb6e63e28f78 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:43.026889 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-819de52c-bf49-490e-bdaf-eb6e63e28f78 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:43.027606 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-819de52c-bf49-490e-bdaf-eb6e63e28f78 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:43.028082 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-819de52c-bf49-490e-bdaf-eb6e63e28f78 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:43.028500 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-819de52c-bf49-490e-bdaf-eb6e63e28f78 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:43.161491 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-819de52c-bf49-490e-bdaf-eb6e63e28f78 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:43.171007 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-819de52c-bf49-490e-bdaf-eb6e63e28f78 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:43.172502 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-819de52c-bf49-490e-bdaf-eb6e63e28f78 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:43.177282 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-819de52c-bf49-490e-bdaf-eb6e63e28f78 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.159763 Sep 26 18:08:43.177282 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 292/598] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:43 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:44.200151 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-597f8242-34e7-4d60-a897-384e56aaa631 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:44.200759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-597f8242-34e7-4d60-a897-384e56aaa631 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:44.208091 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-597f8242-34e7-4d60-a897-384e56aaa631 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:44.208573 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-597f8242-34e7-4d60-a897-384e56aaa631 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:44.209010 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-597f8242-34e7-4d60-a897-384e56aaa631 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:44.209698 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-597f8242-34e7-4d60-a897-384e56aaa631 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:44.210154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-597f8242-34e7-4d60-a897-384e56aaa631 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:44.210584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-597f8242-34e7-4d60-a897-384e56aaa631 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:44.342640 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-597f8242-34e7-4d60-a897-384e56aaa631 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:44.355280 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-597f8242-34e7-4d60-a897-384e56aaa631 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:44.356817 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-597f8242-34e7-4d60-a897-384e56aaa631 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:44.357976 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-597f8242-34e7-4d60-a897-384e56aaa631 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.161796 Sep 26 18:08:44.358540 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 307/599] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:44 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:45.384570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-5f8433db-b68e-4a0a-9685-f66f9c42c9e8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:45.385268 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-5f8433db-b68e-4a0a-9685-f66f9c42c9e8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:45.392134 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5f8433db-b68e-4a0a-9685-f66f9c42c9e8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:45.392611 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5f8433db-b68e-4a0a-9685-f66f9c42c9e8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:45.393639 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5f8433db-b68e-4a0a-9685-f66f9c42c9e8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:45.394350 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5f8433db-b68e-4a0a-9685-f66f9c42c9e8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:45.394800 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5f8433db-b68e-4a0a-9685-f66f9c42c9e8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:45.395216 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5f8433db-b68e-4a0a-9685-f66f9c42c9e8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:45.529535 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-5f8433db-b68e-4a0a-9685-f66f9c42c9e8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:45.539093 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-5f8433db-b68e-4a0a-9685-f66f9c42c9e8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:45.542753 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-5f8433db-b68e-4a0a-9685-f66f9c42c9e8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:45.542753 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-5f8433db-b68e-4a0a-9685-f66f9c42c9e8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.161118 Sep 26 18:08:45.542753 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 293/600] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:45 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:46.568767 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a1028d59-1712-460a-bcab-3bb32070e8bc tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:46.569653 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a1028d59-1712-460a-bcab-3bb32070e8bc tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:46.576492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1028d59-1712-460a-bcab-3bb32070e8bc tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:46.576986 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1028d59-1712-460a-bcab-3bb32070e8bc tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:46.577417 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1028d59-1712-460a-bcab-3bb32070e8bc tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:46.578134 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1028d59-1712-460a-bcab-3bb32070e8bc tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:46.578688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1028d59-1712-460a-bcab-3bb32070e8bc tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:46.579116 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1028d59-1712-460a-bcab-3bb32070e8bc tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:46.737929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a1028d59-1712-460a-bcab-3bb32070e8bc tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:46.747266 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a1028d59-1712-460a-bcab-3bb32070e8bc tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:46.748962 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a1028d59-1712-460a-bcab-3bb32070e8bc tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:46.750195 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a1028d59-1712-460a-bcab-3bb32070e8bc tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.186122 Sep 26 18:08:46.750747 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 308/601] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:46 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:47.778724 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c93f6ac6-3cd3-4592-b396-28f78832b86a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:47.779389 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c93f6ac6-3cd3-4592-b396-28f78832b86a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:47.786109 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c93f6ac6-3cd3-4592-b396-28f78832b86a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:47.786600 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c93f6ac6-3cd3-4592-b396-28f78832b86a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:47.787015 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c93f6ac6-3cd3-4592-b396-28f78832b86a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:47.787766 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c93f6ac6-3cd3-4592-b396-28f78832b86a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:47.788220 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c93f6ac6-3cd3-4592-b396-28f78832b86a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:47.788638 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c93f6ac6-3cd3-4592-b396-28f78832b86a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:47.926618 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c93f6ac6-3cd3-4592-b396-28f78832b86a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:47.935363 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c93f6ac6-3cd3-4592-b396-28f78832b86a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:47.936789 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c93f6ac6-3cd3-4592-b396-28f78832b86a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:47.937923 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c93f6ac6-3cd3-4592-b396-28f78832b86a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.163580 Sep 26 18:08:47.938465 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 294/602] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:47 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:48.130820 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-22543a1f-772f-4aa8-9310-07a3992d53ca req-9ee83719-2fbf-484b-bfd6-0518ed91ab80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6298d28-8cba-46d8-a809-bd0f81e18d58", "name": "network-vif-plugged", "status": "completed", "tag": "a14f5b04-fe69-47de-b23e-8ff9f06a4aae"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:48.141711 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-22543a1f-772f-4aa8-9310-07a3992d53ca req-9ee83719-2fbf-484b-bfd6-0518ed91ab80 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:48.148228 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-22543a1f-772f-4aa8-9310-07a3992d53ca req-9ee83719-2fbf-484b-bfd6-0518ed91ab80 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:48.148228 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-22543a1f-772f-4aa8-9310-07a3992d53ca req-9ee83719-2fbf-484b-bfd6-0518ed91ab80 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:48.155879 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-22543a1f-772f-4aa8-9310-07a3992d53ca req-9ee83719-2fbf-484b-bfd6-0518ed91ab80 service nova] Creating event network-vif-plugged:a14f5b04-fe69-47de-b23e-8ff9f06a4aae for instance f6298d28-8cba-46d8-a809-bd0f81e18d58 on hv-cinder-85931 Sep 26 18:08:48.162108 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-22543a1f-772f-4aa8-9310-07a3992d53ca req-9ee83719-2fbf-484b-bfd6-0518ed91ab80 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035827 Sep 26 18:08:48.162724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 309/603] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:08:48.967050 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-363fd537-2ac3-4881-9e22-b89abb52fa3b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:48.967706 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-363fd537-2ac3-4881-9e22-b89abb52fa3b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:48.975950 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-363fd537-2ac3-4881-9e22-b89abb52fa3b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:48.976465 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-363fd537-2ac3-4881-9e22-b89abb52fa3b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:48.976885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-363fd537-2ac3-4881-9e22-b89abb52fa3b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:48.977813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-363fd537-2ac3-4881-9e22-b89abb52fa3b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:48.978220 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-363fd537-2ac3-4881-9e22-b89abb52fa3b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:48.978649 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-363fd537-2ac3-4881-9e22-b89abb52fa3b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:49.119239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-363fd537-2ac3-4881-9e22-b89abb52fa3b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:49.129337 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-363fd537-2ac3-4881-9e22-b89abb52fa3b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:49.130860 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-363fd537-2ac3-4881-9e22-b89abb52fa3b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:49.132124 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-363fd537-2ac3-4881-9e22-b89abb52fa3b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.169506 Sep 26 18:08:49.132689 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 295/604] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:48 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:50.160372 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-189b1d09-4b52-4b52-b439-89b2ef724a31 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:50.161068 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-189b1d09-4b52-4b52-b439-89b2ef724a31 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:50.167769 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-189b1d09-4b52-4b52-b439-89b2ef724a31 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:50.168260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-189b1d09-4b52-4b52-b439-89b2ef724a31 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:50.168694 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-189b1d09-4b52-4b52-b439-89b2ef724a31 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:50.169402 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-189b1d09-4b52-4b52-b439-89b2ef724a31 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:50.169869 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-189b1d09-4b52-4b52-b439-89b2ef724a31 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:50.170291 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-189b1d09-4b52-4b52-b439-89b2ef724a31 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:50.312741 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-189b1d09-4b52-4b52-b439-89b2ef724a31 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:50.322542 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-189b1d09-4b52-4b52-b439-89b2ef724a31 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:50.324300 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-189b1d09-4b52-4b52-b439-89b2ef724a31 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:50.325489 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-189b1d09-4b52-4b52-b439-89b2ef724a31 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.170429 Sep 26 18:08:50.326049 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 310/605] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:50 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:51.353583 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f5b0beab-acab-4e65-a279-fd8cfc2b2207 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:51.354414 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f5b0beab-acab-4e65-a279-fd8cfc2b2207 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:51.356739 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=32 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:51.362037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5b0beab-acab-4e65-a279-fd8cfc2b2207 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:51.365401 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5b0beab-acab-4e65-a279-fd8cfc2b2207 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:51.365401 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5b0beab-acab-4e65-a279-fd8cfc2b2207 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:51.365401 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5b0beab-acab-4e65-a279-fd8cfc2b2207 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:51.365401 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5b0beab-acab-4e65-a279-fd8cfc2b2207 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:51.365789 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5b0beab-acab-4e65-a279-fd8cfc2b2207 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:51.515072 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f5b0beab-acab-4e65-a279-fd8cfc2b2207 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:51.526153 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f5b0beab-acab-4e65-a279-fd8cfc2b2207 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:51.527598 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f5b0beab-acab-4e65-a279-fd8cfc2b2207 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:51.529017 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f5b0beab-acab-4e65-a279-fd8cfc2b2207 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1808 microversion: 2.20 time: 0.179341 Sep 26 18:08:51.531757 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 296/606] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:51 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:52.556123 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-fd4f761f-e43e-455c-b5d2-80a574bc47a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:52.556727 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-fd4f761f-e43e-455c-b5d2-80a574bc47a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:52.563813 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fd4f761f-e43e-455c-b5d2-80a574bc47a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:52.564309 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fd4f761f-e43e-455c-b5d2-80a574bc47a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:52.564756 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fd4f761f-e43e-455c-b5d2-80a574bc47a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:52.566536 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fd4f761f-e43e-455c-b5d2-80a574bc47a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:52.567000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fd4f761f-e43e-455c-b5d2-80a574bc47a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:52.567431 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fd4f761f-e43e-455c-b5d2-80a574bc47a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:52.571822 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=83 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:52.706780 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-fd4f761f-e43e-455c-b5d2-80a574bc47a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:52.716543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-fd4f761f-e43e-455c-b5d2-80a574bc47a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:52.718000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-fd4f761f-e43e-455c-b5d2-80a574bc47a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:08:52.719157 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-fd4f761f-e43e-455c-b5d2-80a574bc47a9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1795 microversion: 2.20 time: 0.167129 Sep 26 18:08:52.719737 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 311/607] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:08:52 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1795 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:08:54.847732 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-5fdb7d64-35b0-49b1-b5e5-78b773ab501d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:08:54.848247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-5fdb7d64-35b0-49b1-b5e5-78b773ab501d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:54.854647 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5fdb7d64-35b0-49b1-b5e5-78b773ab501d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:54.855130 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5fdb7d64-35b0-49b1-b5e5-78b773ab501d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:54.855563 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5fdb7d64-35b0-49b1-b5e5-78b773ab501d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:54.856310 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5fdb7d64-35b0-49b1-b5e5-78b773ab501d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:54.856764 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5fdb7d64-35b0-49b1-b5e5-78b773ab501d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:54.857187 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5fdb7d64-35b0-49b1-b5e5-78b773ab501d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:54.859609 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=77 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:54.880913 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-5fdb7d64-35b0-49b1-b5e5-78b773ab501d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/ips" status: 200 len: 150 microversion: 2.1 time: 0.155336 Sep 26 18:08:54.881456 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 297/608] 10.222.0.67 () {58 vars in 1248 bytes} [Mon Sep 26 18:08:54 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/ips => generated 150 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:08:56.570271 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a13ffd41-90d0-49eb-a0c2-136df99d92ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "818ba760-f6e0-4bb7-8349-4951582ada47"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:08:56.572757 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a13ffd41-90d0-49eb-a0c2-136df99d92ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:08:56.579673 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a13ffd41-90d0-49eb-a0c2-136df99d92ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:56.579927 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a13ffd41-90d0-49eb-a0c2-136df99d92ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:56.580413 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a13ffd41-90d0-49eb-a0c2-136df99d92ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:56.581238 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a13ffd41-90d0-49eb-a0c2-136df99d92ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:08:56.581702 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a13ffd41-90d0-49eb-a0c2-136df99d92ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:08:56.582135 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a13ffd41-90d0-49eb-a0c2-136df99d92ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:08:57.510391 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a13ffd41-90d0-49eb-a0c2-136df99d92ea tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "POST /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.944017 Sep 26 18:08:57.511031 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 312/609] 10.222.0.67 () {60 vars in 1323 bytes} [Mon Sep 26 18:08:56 2022] POST /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments => generated 194 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:09:05.434273 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b48c00a2-5e73-4dac-8cec-8d2ba5dc826a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:05.435008 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b48c00a2-5e73-4dac-8cec-8d2ba5dc826a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:05.438046 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=3 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:05.446606 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b48c00a2-5e73-4dac-8cec-8d2ba5dc826a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:05.447092 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b48c00a2-5e73-4dac-8cec-8d2ba5dc826a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:05.447530 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b48c00a2-5e73-4dac-8cec-8d2ba5dc826a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:05.448271 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b48c00a2-5e73-4dac-8cec-8d2ba5dc826a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:05.448731 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b48c00a2-5e73-4dac-8cec-8d2ba5dc826a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:05.449157 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b48c00a2-5e73-4dac-8cec-8d2ba5dc826a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:05.538431 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-b48c00a2-5e73-4dac-8cec-8d2ba5dc826a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lazy-loading 'services' on Instance uuid a44a359c-9109-4982-a7d2-ba4622f28fc6 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:09:05.932361 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b48c00a2-5e73-4dac-8cec-8d2ba5dc826a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-volume_attachments/7e2f368f-d3ce-48e4-b1e3-4efa15e1f1a1" status: 202 len: 0 microversion: 2.1 time: 0.503170 Sep 26 18:09:05.933175 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 298/610] 10.222.0.67 () {58 vars in 1416 bytes} [Mon Sep 26 18:09:05 2022] DELETE /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-volume_attachments/7e2f368f-d3ce-48e4-b1e3-4efa15e1f1a1 => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:09:05.942282 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-def8ef58-e006-4a1f-819a-57d30447c841 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:05.944743 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-def8ef58-e006-4a1f-819a-57d30447c841 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:05.951903 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-def8ef58-e006-4a1f-819a-57d30447c841 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:05.952390 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-def8ef58-e006-4a1f-819a-57d30447c841 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:05.952833 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-def8ef58-e006-4a1f-819a-57d30447c841 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:05.953554 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-def8ef58-e006-4a1f-819a-57d30447c841 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:05.953991 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-def8ef58-e006-4a1f-819a-57d30447c841 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:05.954409 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-def8ef58-e006-4a1f-819a-57d30447c841 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:05.986100 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-def8ef58-e006-4a1f-819a-57d30447c841 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048285 Sep 26 18:09:05.987355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 313/611] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:09:05 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:09:07.000067 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c95fbf29-480a-4095-8e32-f21aa11d357e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:07.003086 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c95fbf29-480a-4095-8e32-f21aa11d357e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:07.009985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c95fbf29-480a-4095-8e32-f21aa11d357e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:07.010475 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c95fbf29-480a-4095-8e32-f21aa11d357e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:07.011013 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c95fbf29-480a-4095-8e32-f21aa11d357e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:07.014859 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c95fbf29-480a-4095-8e32-f21aa11d357e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:07.014859 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c95fbf29-480a-4095-8e32-f21aa11d357e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:07.014859 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c95fbf29-480a-4095-8e32-f21aa11d357e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:07.050560 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c95fbf29-480a-4095-8e32-f21aa11d357e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054830 Sep 26 18:09:07.055733 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 299/612] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:09:06 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:09:07.266521 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9c4f6418-c9d5-4e21-a2a7-692d4cfa8bc6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "818ba760-f6e0-4bb7-8349-4951582ada47"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:07.268985 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9c4f6418-c9d5-4e21-a2a7-692d4cfa8bc6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:07.277374 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9c4f6418-c9d5-4e21-a2a7-692d4cfa8bc6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:07.279584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9c4f6418-c9d5-4e21-a2a7-692d4cfa8bc6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:07.279584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9c4f6418-c9d5-4e21-a2a7-692d4cfa8bc6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:07.279584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9c4f6418-c9d5-4e21-a2a7-692d4cfa8bc6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:07.279584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9c4f6418-c9d5-4e21-a2a7-692d4cfa8bc6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:07.280044 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9c4f6418-c9d5-4e21-a2a7-692d4cfa8bc6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:07.370761 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-9c4f6418-c9d5-4e21-a2a7-692d4cfa8bc6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] HTTP exception thrown: Invalid volume: volume 818ba760-f6e0-4bb7-8349-4951582ada47 is already attached to instances: e8560d88-7c26-4e3c-8af6-aac7ac9aa390 Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9c4f6418-c9d5-4e21-a2a7-692d4cfa8bc6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Request method failure captured: Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: POST /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments HTTP/1.1 Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 74 Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMelsNex1FlD2CBY8G-ysnjsye_l-7KQaYKxzjq-uqqw_c6lt3XOkxaeXEOSBPxdrGfGNF6J_jwjGWJdIRzcPmWbMtwg-2UVrF8ghY8jl9NOGZb0sL_3XrXpF2FeqtmN-NjzE_b12zyopUCDg2jN5eXXFmLWv81UC7SHabJvYKq1cYR8 Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:09:07.372906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:09:07.375355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:09:07.375355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:09:07.375355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:09:07.375355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:09:07.375355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:09:07.375355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:09:07.375355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:09:07.375355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 0bede3a601f941e7abc9fd16983679b2 Sep 26 18:09:07.375355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:09:07.375355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Sep 26 18:09:07.375355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {"volumeAttachment": {"volumeId": "818ba760-f6e0-4bb7-8349-4951582ada47"}} Sep 26 18:09:07.375355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Invalid volume: volume 818ba760-f6e0-4bb7-8349-4951582ada47 is already attached to instances: e8560d88-7c26-4e3c-8af6-aac7ac9aa390 Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'server_id': 'e8560d88-7c26-4e3c-8af6-aac7ac9aa390', 'body': {'volumeAttachment': {'volumeId': '818ba760-f6e0-4bb7-8349-4951582ada47'}}} Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 818ba760-f6e0-4bb7-8349-4951582ada47 is already attached to instances: e8560d88-7c26-4e3c-8af6-aac7ac9aa390 Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:07.378012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 818ba760-f6e0-4bb7-8349-4951582ada47 is already attached to instances: e8560d88-7c26-4e3c-8af6-aac7ac9aa390 Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:07.381322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:09:07.384517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:09:07.384517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:09:07.384517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:09:07.384517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 818ba760-f6e0-4bb7-8349-4951582ada47 is already attached to instances: e8560d88-7c26-4e3c-8af6-aac7ac9aa390 Sep 26 18:09:07.384517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:07.384517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9c4f6418-c9d5-4e21-a2a7-692d4cfa8bc6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Returning 400 to user: Invalid volume: volume 818ba760-f6e0-4bb7-8349-4951582ada47 is already attached to instances: e8560d88-7c26-4e3c-8af6-aac7ac9aa390 {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:09:07.384517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9c4f6418-c9d5-4e21-a2a7-692d4cfa8bc6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "POST /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112000 Sep 26 18:09:07.384517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 314/613] 10.222.0.67 () {60 vars in 1323 bytes} [Mon Sep 26 18:09:07 2022] POST /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 18:09:07.449225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-84b6c5f8-c268-42a4-a3c2-aa809e70fbcb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:07.449717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-84b6c5f8-c268-42a4-a3c2-aa809e70fbcb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:07.456011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-84b6c5f8-c268-42a4-a3c2-aa809e70fbcb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:07.456506 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-84b6c5f8-c268-42a4-a3c2-aa809e70fbcb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:07.456951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-84b6c5f8-c268-42a4-a3c2-aa809e70fbcb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:07.457659 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-84b6c5f8-c268-42a4-a3c2-aa809e70fbcb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:07.458170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-84b6c5f8-c268-42a4-a3c2-aa809e70fbcb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:07.458592 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-84b6c5f8-c268-42a4-a3c2-aa809e70fbcb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:07.559751 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-84b6c5f8-c268-42a4-a3c2-aa809e70fbcb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lazy-loading 'services' on Instance uuid e8560d88-7c26-4e3c-8af6-aac7ac9aa390 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:09:07.980651 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-84b6c5f8-c268-42a4-a3c2-aa809e70fbcb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments/818ba760-f6e0-4bb7-8349-4951582ada47" status: 202 len: 0 microversion: 2.1 time: 0.535221 Sep 26 18:09:07.981589 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 300/614] 10.222.0.67 () {58 vars in 1416 bytes} [Mon Sep 26 18:09:07 2022] DELETE /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments/818ba760-f6e0-4bb7-8349-4951582ada47 => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:09:07.992519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9f4ab1dd-5205-4ae0-a410-94110dd7294b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:07.993847 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9f4ab1dd-5205-4ae0-a410-94110dd7294b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:08.000140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9f4ab1dd-5205-4ae0-a410-94110dd7294b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:08.000632 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9f4ab1dd-5205-4ae0-a410-94110dd7294b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:08.002026 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9f4ab1dd-5205-4ae0-a410-94110dd7294b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:08.002026 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9f4ab1dd-5205-4ae0-a410-94110dd7294b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:08.002329 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9f4ab1dd-5205-4ae0-a410-94110dd7294b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:08.002734 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9f4ab1dd-5205-4ae0-a410-94110dd7294b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:08.050337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9f4ab1dd-5205-4ae0-a410-94110dd7294b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049691 Sep 26 18:09:08.050337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 315/615] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:09:07 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:09:08.063212 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-7bea120c-f94f-4fac-afd2-9982a37a32cc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:08.066504 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-7bea120c-f94f-4fac-afd2-9982a37a32cc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:08.074046 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7bea120c-f94f-4fac-afd2-9982a37a32cc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:08.074550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7bea120c-f94f-4fac-afd2-9982a37a32cc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:08.074984 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7bea120c-f94f-4fac-afd2-9982a37a32cc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:08.075842 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7bea120c-f94f-4fac-afd2-9982a37a32cc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:08.076205 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7bea120c-f94f-4fac-afd2-9982a37a32cc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:08.076627 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7bea120c-f94f-4fac-afd2-9982a37a32cc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:08.109278 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-7bea120c-f94f-4fac-afd2-9982a37a32cc tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050424 Sep 26 18:09:08.110022 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 301/616] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:09:08 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 18:09:08.198641 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-01ba783e-8931-4ef2-a186-da6825c40661 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:08.199271 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-01ba783e-8931-4ef2-a186-da6825c40661 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:08.206248 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-01ba783e-8931-4ef2-a186-da6825c40661 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:08.206248 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-01ba783e-8931-4ef2-a186-da6825c40661 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:08.216953 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-01ba783e-8931-4ef2-a186-da6825c40661 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:08.216953 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-01ba783e-8931-4ef2-a186-da6825c40661 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:08.216953 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-01ba783e-8931-4ef2-a186-da6825c40661 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:08.216953 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-01ba783e-8931-4ef2-a186-da6825c40661 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:08.240236 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-01ba783e-8931-4ef2-a186-da6825c40661 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Going to try to terminate instance {{(pid=121029) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:09:08.775613 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-01ba783e-8931-4ef2-a186-da6825c40661 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 204 len: 0 microversion: 2.1 time: 0.580837 Sep 26 18:09:08.776522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 316/617] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:09:08 2022] DELETE /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:09:08.786192 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-13a71765-beb3-460c-9bf0-b5375a24a259 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:08.787703 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-13a71765-beb3-460c-9bf0-b5375a24a259 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:08.793454 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-13a71765-beb3-460c-9bf0-b5375a24a259 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:08.793940 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-13a71765-beb3-460c-9bf0-b5375a24a259 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:08.794372 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-13a71765-beb3-460c-9bf0-b5375a24a259 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:08.795078 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-13a71765-beb3-460c-9bf0-b5375a24a259 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:08.795526 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-13a71765-beb3-460c-9bf0-b5375a24a259 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:08.795973 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-13a71765-beb3-460c-9bf0-b5375a24a259 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:08.944393 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-13a71765-beb3-460c-9bf0-b5375a24a259 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:08.953948 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-13a71765-beb3-460c-9bf0-b5375a24a259 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1688 microversion: 2.1 time: 0.172494 Sep 26 18:09:08.954544 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 302/618] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:08 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:09.062027 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c0da1aa4-a52c-4d9f-952b-f4c192fb937b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:09.064269 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c0da1aa4-a52c-4d9f-952b-f4c192fb937b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:09.070621 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c0da1aa4-a52c-4d9f-952b-f4c192fb937b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:09.071097 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c0da1aa4-a52c-4d9f-952b-f4c192fb937b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:09.071523 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c0da1aa4-a52c-4d9f-952b-f4c192fb937b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:09.072234 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c0da1aa4-a52c-4d9f-952b-f4c192fb937b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:09.072682 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c0da1aa4-a52c-4d9f-952b-f4c192fb937b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:09.073097 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c0da1aa4-a52c-4d9f-952b-f4c192fb937b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:09.104380 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c0da1aa4-a52c-4d9f-952b-f4c192fb937b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046681 Sep 26 18:09:09.111404 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 317/619] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:09:09 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:09:09.979328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-497e05c1-c806-43c3-b201-7ee5b2cd7d12 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:09.980150 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-497e05c1-c806-43c3-b201-7ee5b2cd7d12 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:09.996405 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-497e05c1-c806-43c3-b201-7ee5b2cd7d12 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:09.996405 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-497e05c1-c806-43c3-b201-7ee5b2cd7d12 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:09.996405 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-497e05c1-c806-43c3-b201-7ee5b2cd7d12 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:09.996405 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-497e05c1-c806-43c3-b201-7ee5b2cd7d12 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:09.996913 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-497e05c1-c806-43c3-b201-7ee5b2cd7d12 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:09.996913 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-497e05c1-c806-43c3-b201-7ee5b2cd7d12 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:10.122437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f7284fba-bc41-49dd-8422-c3c084cbfafc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:10.126660 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f7284fba-bc41-49dd-8422-c3c084cbfafc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:10.130362 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:10.135466 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f7284fba-bc41-49dd-8422-c3c084cbfafc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:10.158875 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f7284fba-bc41-49dd-8422-c3c084cbfafc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:10.158875 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f7284fba-bc41-49dd-8422-c3c084cbfafc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:10.158875 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f7284fba-bc41-49dd-8422-c3c084cbfafc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:10.158875 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f7284fba-bc41-49dd-8422-c3c084cbfafc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:10.159496 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f7284fba-bc41-49dd-8422-c3c084cbfafc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:10.168437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-497e05c1-c806-43c3-b201-7ee5b2cd7d12 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:10.176624 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f7284fba-bc41-49dd-8422-c3c084cbfafc tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061856 Sep 26 18:09:10.177224 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 318/620] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:09:10 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:09:10.177525 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-497e05c1-c806-43c3-b201-7ee5b2cd7d12 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1688 microversion: 2.1 time: 0.202404 Sep 26 18:09:10.178106 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 303/621] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:09 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1688 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:11.190224 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a134ad03-2731-4f2b-b950-0e3bc1e7fee1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:11.192391 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a134ad03-2731-4f2b-b950-0e3bc1e7fee1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:11.199777 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a134ad03-2731-4f2b-b950-0e3bc1e7fee1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:11.200267 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a134ad03-2731-4f2b-b950-0e3bc1e7fee1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:11.200699 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a134ad03-2731-4f2b-b950-0e3bc1e7fee1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:11.201394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a134ad03-2731-4f2b-b950-0e3bc1e7fee1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:11.201846 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a134ad03-2731-4f2b-b950-0e3bc1e7fee1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:11.201951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1c256ae3-368a-4815-a5eb-3319a115ae08 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:11.202398 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a134ad03-2731-4f2b-b950-0e3bc1e7fee1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:11.202617 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1c256ae3-368a-4815-a5eb-3319a115ae08 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:11.209826 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c256ae3-368a-4815-a5eb-3319a115ae08 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:11.210348 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c256ae3-368a-4815-a5eb-3319a115ae08 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:11.210784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c256ae3-368a-4815-a5eb-3319a115ae08 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:11.211602 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c256ae3-368a-4815-a5eb-3319a115ae08 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:11.212005 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c256ae3-368a-4815-a5eb-3319a115ae08 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:11.212350 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1c256ae3-368a-4815-a5eb-3319a115ae08 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:11.235516 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a134ad03-2731-4f2b-b950-0e3bc1e7fee1 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049273 Sep 26 18:09:11.236029 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 319/622] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:09:11 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:09:11.379581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1c256ae3-368a-4815-a5eb-3319a115ae08 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:11.388597 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1c256ae3-368a-4815-a5eb-3319a115ae08 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1688 microversion: 2.1 time: 0.191122 Sep 26 18:09:11.389165 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 304/623] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:11 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:12.248891 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-068f7b7f-1c53-45e6-a399-11558a69eedb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:12.251044 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-068f7b7f-1c53-45e6-a399-11558a69eedb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:12.257872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-068f7b7f-1c53-45e6-a399-11558a69eedb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:12.258365 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-068f7b7f-1c53-45e6-a399-11558a69eedb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:12.258806 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-068f7b7f-1c53-45e6-a399-11558a69eedb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:12.259504 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-068f7b7f-1c53-45e6-a399-11558a69eedb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:12.259994 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-068f7b7f-1c53-45e6-a399-11558a69eedb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:12.260426 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-068f7b7f-1c53-45e6-a399-11558a69eedb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:12.292955 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-068f7b7f-1c53-45e6-a399-11558a69eedb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048149 Sep 26 18:09:12.293516 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 320/624] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:09:12 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:09:12.413736 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f2d649ce-4a2a-4788-9363-d554ca6ff919 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:12.414364 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f2d649ce-4a2a-4788-9363-d554ca6ff919 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:12.422045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f2d649ce-4a2a-4788-9363-d554ca6ff919 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:12.422571 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f2d649ce-4a2a-4788-9363-d554ca6ff919 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:12.423035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f2d649ce-4a2a-4788-9363-d554ca6ff919 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:12.423848 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f2d649ce-4a2a-4788-9363-d554ca6ff919 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:12.424413 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f2d649ce-4a2a-4788-9363-d554ca6ff919 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:12.424836 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f2d649ce-4a2a-4788-9363-d554ca6ff919 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:12.566441 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f2d649ce-4a2a-4788-9363-d554ca6ff919 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:12.574622 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f2d649ce-4a2a-4788-9363-d554ca6ff919 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1688 microversion: 2.1 time: 0.165524 Sep 26 18:09:12.575200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 305/625] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:12 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:13.306632 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-6663a3aa-8509-4de1-ad14-f8230d0dcc67 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:13.309168 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-6663a3aa-8509-4de1-ad14-f8230d0dcc67 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:13.316511 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6663a3aa-8509-4de1-ad14-f8230d0dcc67 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:13.316999 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6663a3aa-8509-4de1-ad14-f8230d0dcc67 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:13.317433 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6663a3aa-8509-4de1-ad14-f8230d0dcc67 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:13.318137 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6663a3aa-8509-4de1-ad14-f8230d0dcc67 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:13.318595 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6663a3aa-8509-4de1-ad14-f8230d0dcc67 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:13.319019 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6663a3aa-8509-4de1-ad14-f8230d0dcc67 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:13.351636 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-6663a3aa-8509-4de1-ad14-f8230d0dcc67 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049005 Sep 26 18:09:13.352241 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 321/626] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:09:13 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 18:09:13.419491 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a09a1a4d-ffcf-4d8f-bf31-d672ef1e8e1c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:13.420115 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a09a1a4d-ffcf-4d8f-bf31-d672ef1e8e1c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:13.426902 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a09a1a4d-ffcf-4d8f-bf31-d672ef1e8e1c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:13.427390 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a09a1a4d-ffcf-4d8f-bf31-d672ef1e8e1c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:13.427861 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a09a1a4d-ffcf-4d8f-bf31-d672ef1e8e1c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:13.428566 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a09a1a4d-ffcf-4d8f-bf31-d672ef1e8e1c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:13.429016 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a09a1a4d-ffcf-4d8f-bf31-d672ef1e8e1c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:13.429441 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a09a1a4d-ffcf-4d8f-bf31-d672ef1e8e1c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:13.458057 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a09a1a4d-ffcf-4d8f-bf31-d672ef1e8e1c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Going to try to terminate instance {{(pid=121028) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:09:13.598568 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a8cab122-d85b-40bd-94de-360698e5ea1c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:13.599183 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a8cab122-d85b-40bd-94de-360698e5ea1c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:13.605116 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8cab122-d85b-40bd-94de-360698e5ea1c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:13.605603 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8cab122-d85b-40bd-94de-360698e5ea1c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:13.606065 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8cab122-d85b-40bd-94de-360698e5ea1c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:13.606749 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8cab122-d85b-40bd-94de-360698e5ea1c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:13.607205 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8cab122-d85b-40bd-94de-360698e5ea1c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:13.607630 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8cab122-d85b-40bd-94de-360698e5ea1c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:13.727717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a8cab122-d85b-40bd-94de-360698e5ea1c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:13.727717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a8cab122-d85b-40bd-94de-360698e5ea1c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1620 microversion: 2.1 time: 0.113614 Sep 26 18:09:13.727717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 322/627] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:13 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1620 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:09:13.918361 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a09a1a4d-ffcf-4d8f-bf31-d672ef1e8e1c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 204 len: 0 microversion: 2.1 time: 0.502458 Sep 26 18:09:13.919055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 306/628] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:09:13 2022] DELETE /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:09:13.929111 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1f808f65-7296-40e1-8314-039860eb8fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:13.930784 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1f808f65-7296-40e1-8314-039860eb8fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:13.941171 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f808f65-7296-40e1-8314-039860eb8fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:13.941617 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f808f65-7296-40e1-8314-039860eb8fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:13.942377 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f808f65-7296-40e1-8314-039860eb8fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:13.943670 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f808f65-7296-40e1-8314-039860eb8fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:13.944540 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f808f65-7296-40e1-8314-039860eb8fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:13.945317 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1f808f65-7296-40e1-8314-039860eb8fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:14.054366 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-9048f87a-0a94-4010-b026-023e6dca459a req-4b5927e9-92f3-491f-9587-0c077309ee39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44a359c-9109-4982-a7d2-ba4622f28fc6", "name": "network-vif-deleted", "tag": "9e6b89b3-2f73-4b79-94eb-c77bfe00bb5a"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:14.066645 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-9048f87a-0a94-4010-b026-023e6dca459a req-4b5927e9-92f3-491f-9587-0c077309ee39 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:14.070815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-9048f87a-0a94-4010-b026-023e6dca459a req-4b5927e9-92f3-491f-9587-0c077309ee39 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:14.070815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-9048f87a-0a94-4010-b026-023e6dca459a req-4b5927e9-92f3-491f-9587-0c077309ee39 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:14.087958 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-9048f87a-0a94-4010-b026-023e6dca459a req-4b5927e9-92f3-491f-9587-0c077309ee39 service nova] Creating event network-vif-deleted:9e6b89b3-2f73-4b79-94eb-c77bfe00bb5a for instance a44a359c-9109-4982-a7d2-ba4622f28fc6 on hv-cinder-85931 Sep 26 18:09:14.093439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-9048f87a-0a94-4010-b026-023e6dca459a req-4b5927e9-92f3-491f-9587-0c077309ee39 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104177 Sep 26 18:09:14.094746 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 307/629] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:09:14.138376 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1f808f65-7296-40e1-8314-039860eb8fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:14.148685 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1f808f65-7296-40e1-8314-039860eb8fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1683 microversion: 2.1 time: 0.224201 Sep 26 18:09:14.149508 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 323/630] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:13 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1683 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:09:14.733021 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c3b8a60f-ffdd-4af8-b240-5a5acd63ed66 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:14.733728 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c3b8a60f-ffdd-4af8-b240-5a5acd63ed66 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:14.741062 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c3b8a60f-ffdd-4af8-b240-5a5acd63ed66 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:14.741567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c3b8a60f-ffdd-4af8-b240-5a5acd63ed66 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:14.742003 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c3b8a60f-ffdd-4af8-b240-5a5acd63ed66 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:14.742714 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c3b8a60f-ffdd-4af8-b240-5a5acd63ed66 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:14.743167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c3b8a60f-ffdd-4af8-b240-5a5acd63ed66 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:14.743590 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c3b8a60f-ffdd-4af8-b240-5a5acd63ed66 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:14.811983 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c3b8a60f-ffdd-4af8-b240-5a5acd63ed66 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:14.820401 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c3b8a60f-ffdd-4af8-b240-5a5acd63ed66 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1620 microversion: 2.1 time: 0.092288 Sep 26 18:09:14.820976 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 308/631] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:14 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1620 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:15.173667 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-84d75616-1587-4eb4-b6ab-58188e34b103 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:15.174711 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-84d75616-1587-4eb4-b6ab-58188e34b103 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:15.181323 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-84d75616-1587-4eb4-b6ab-58188e34b103 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:15.185842 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-84d75616-1587-4eb4-b6ab-58188e34b103 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:15.185842 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-84d75616-1587-4eb4-b6ab-58188e34b103 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:15.185842 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-84d75616-1587-4eb4-b6ab-58188e34b103 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:15.185842 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-84d75616-1587-4eb4-b6ab-58188e34b103 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:15.186254 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-84d75616-1587-4eb4-b6ab-58188e34b103 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:15.324077 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-84d75616-1587-4eb4-b6ab-58188e34b103 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:15.326278 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:15.334241 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-84d75616-1587-4eb4-b6ab-58188e34b103 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1683 microversion: 2.1 time: 0.164633 Sep 26 18:09:15.334872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 324/632] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:15 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:15.844036 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d3438a27-e00f-439b-8a52-7f030d03114b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:15.844653 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d3438a27-e00f-439b-8a52-7f030d03114b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:15.851580 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d3438a27-e00f-439b-8a52-7f030d03114b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:15.852103 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d3438a27-e00f-439b-8a52-7f030d03114b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:15.852544 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d3438a27-e00f-439b-8a52-7f030d03114b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:15.853314 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d3438a27-e00f-439b-8a52-7f030d03114b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:15.853773 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d3438a27-e00f-439b-8a52-7f030d03114b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:15.854199 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d3438a27-e00f-439b-8a52-7f030d03114b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:15.917123 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d3438a27-e00f-439b-8a52-7f030d03114b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:15.926207 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d3438a27-e00f-439b-8a52-7f030d03114b tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1620 microversion: 2.1 time: 0.085937 Sep 26 18:09:15.926788 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 309/633] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:15 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1620 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:16.359428 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-768250b9-5e21-426a-820c-06b38db44e47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:16.360098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-768250b9-5e21-426a-820c-06b38db44e47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:16.367974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-768250b9-5e21-426a-820c-06b38db44e47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:16.368521 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-768250b9-5e21-426a-820c-06b38db44e47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:16.369004 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-768250b9-5e21-426a-820c-06b38db44e47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:16.369731 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-768250b9-5e21-426a-820c-06b38db44e47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:16.370187 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-768250b9-5e21-426a-820c-06b38db44e47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:16.370861 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-768250b9-5e21-426a-820c-06b38db44e47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:16.508100 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-768250b9-5e21-426a-820c-06b38db44e47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:16.517427 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-768250b9-5e21-426a-820c-06b38db44e47 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1683 microversion: 2.1 time: 0.161626 Sep 26 18:09:16.518943 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 325/634] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:16 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:16.949941 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-378c40cf-322e-48c2-b88e-0cf9fa758e39 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:16.950728 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-378c40cf-322e-48c2-b88e-0cf9fa758e39 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:16.959637 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-378c40cf-322e-48c2-b88e-0cf9fa758e39 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:16.960150 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-378c40cf-322e-48c2-b88e-0cf9fa758e39 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:16.960608 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-378c40cf-322e-48c2-b88e-0cf9fa758e39 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:16.961284 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-378c40cf-322e-48c2-b88e-0cf9fa758e39 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:16.961802 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-378c40cf-322e-48c2-b88e-0cf9fa758e39 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:16.962164 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-378c40cf-322e-48c2-b88e-0cf9fa758e39 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:17.004747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-378c40cf-322e-48c2-b88e-0cf9fa758e39 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:17.005231 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-378c40cf-322e-48c2-b88e-0cf9fa758e39 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:17.005894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-378c40cf-322e-48c2-b88e-0cf9fa758e39 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:17.006338 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-378c40cf-322e-48c2-b88e-0cf9fa758e39 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lazy-loading 'fault' on Instance uuid a44a359c-9109-4982-a7d2-ba4622f28fc6 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:09:17.090842 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-378c40cf-322e-48c2-b88e-0cf9fa758e39 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:17.100680 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-378c40cf-322e-48c2-b88e-0cf9fa758e39 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 200 len: 1335 microversion: 2.1 time: 0.154342 Sep 26 18:09:17.115689 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 310/635] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:16 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 1335 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:17.546770 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d10245e4-7732-46c5-82c8-c8654925af71 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:17.547424 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d10245e4-7732-46c5-82c8-c8654925af71 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:17.556129 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d10245e4-7732-46c5-82c8-c8654925af71 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:17.556918 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d10245e4-7732-46c5-82c8-c8654925af71 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:17.560521 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d10245e4-7732-46c5-82c8-c8654925af71 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:17.560521 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d10245e4-7732-46c5-82c8-c8654925af71 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:17.560521 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d10245e4-7732-46c5-82c8-c8654925af71 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:17.560521 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d10245e4-7732-46c5-82c8-c8654925af71 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:17.683896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d10245e4-7732-46c5-82c8-c8654925af71 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:17.694398 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d10245e4-7732-46c5-82c8-c8654925af71 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1615 microversion: 2.1 time: 0.155314 Sep 26 18:09:17.695379 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 326/636] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:17 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1615 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:17.815473 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-1c623d1d-9169-4639-9e04-507d6f9108c3 req-8c0569f0-9218-49fe-b2dd-9cade76c756f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8560d88-7c26-4e3c-8af6-aac7ac9aa390", "name": "network-vif-deleted", "tag": "f7bfcff1-da00-43a3-96d5-30997503c634"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:17.825690 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-1c623d1d-9169-4639-9e04-507d6f9108c3 req-8c0569f0-9218-49fe-b2dd-9cade76c756f service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:17.826176 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-1c623d1d-9169-4639-9e04-507d6f9108c3 req-8c0569f0-9218-49fe-b2dd-9cade76c756f service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:17.826611 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-1c623d1d-9169-4639-9e04-507d6f9108c3 req-8c0569f0-9218-49fe-b2dd-9cade76c756f service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:17.841320 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-1c623d1d-9169-4639-9e04-507d6f9108c3 req-8c0569f0-9218-49fe-b2dd-9cade76c756f service nova] Creating event network-vif-deleted:f7bfcff1-da00-43a3-96d5-30997503c634 for instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 on hv-cinder-85931 Sep 26 18:09:17.847957 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-1c623d1d-9169-4639-9e04-507d6f9108c3 req-8c0569f0-9218-49fe-b2dd-9cade76c756f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037066 Sep 26 18:09:17.849208 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 311/637] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:09:18.132292 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bc52bece-ff5d-40a7-b8d7-9003fd7354ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:18.132990 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-bc52bece-ff5d-40a7-b8d7-9003fd7354ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: a44a359c-9109-4982-a7d2-ba4622f28fc6] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:18.139085 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bc52bece-ff5d-40a7-b8d7-9003fd7354ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:18.139573 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bc52bece-ff5d-40a7-b8d7-9003fd7354ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:18.140327 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bc52bece-ff5d-40a7-b8d7-9003fd7354ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:18.141253 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bc52bece-ff5d-40a7-b8d7-9003fd7354ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:18.141715 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bc52bece-ff5d-40a7-b8d7-9003fd7354ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:18.142133 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bc52bece-ff5d-40a7-b8d7-9003fd7354ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:18.173174 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-bc52bece-ff5d-40a7-b8d7-9003fd7354ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] HTTP exception thrown: Instance a44a359c-9109-4982-a7d2-ba4622f28fc6 could not be found. Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bc52bece-ff5d-40a7-b8d7-9003fd7354ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Request method failure captured: Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 HTTP/1.1 Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMelx-ipjEriwiSD7ibs9Z44BoWfZT3uyXwYPCzZ4uCB7LTqLOGaMmSnH6oOKtZayloye70yYnWFt5iXYcqgw8QZ2-eCL-Wz0unSbrK1_8M_uOgP8VNfV8jd2_jG5Mc5Zpq0az6KYot6uehZzTvsSYbg58zlBHSF8YA06MR56ri3H5AQ Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: 3a15ebd862054a64ac1d739db5adc3a2 Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1906646791 Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:09:18.175445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:09:18.176782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:09:18.176782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1906646791 Sep 26 18:09:18.176782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: 3a15ebd862054a64ac1d739db5adc3a2 Sep 26 18:09:18.176782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1906646791 Sep 26 18:09:18.176782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-ServerRescueNegativeTestJSON-1906646791-project Sep 26 18:09:18.176782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:09:18.176782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:09:18.176782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 97ed136f68c540abbdaf04cbe34a682e Sep 26 18:09:18.176782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1906646791-project Sep 26 18:09:18.176782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:09:18.176782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance a44a359c-9109-4982-a7d2-ba4622f28fc6 could not be found. Sep 26 18:09:18.176782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': 'a44a359c-9109-4982-a7d2-ba4622f28fc6'} Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a44a359c-9109-4982-a7d2-ba4622f28fc6 could not be found. Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:09:18.177688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a44a359c-9109-4982-a7d2-ba4622f28fc6 could not be found. Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a44a359c-9109-4982-a7d2-ba4622f28fc6 could not be found. Sep 26 18:09:18.179513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:18.181543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bc52bece-ff5d-40a7-b8d7-9003fd7354ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Returning 404 to user: Instance a44a359c-9109-4982-a7d2-ba4622f28fc6 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:09:18.181543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bc52bece-ff5d-40a7-b8d7-9003fd7354ce tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6" status: 404 len: 111 microversion: 2.1 time: 0.049882 Sep 26 18:09:18.181543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 327/638] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:18 2022] GET /compute/v2.1/servers/a44a359c-9109-4982-a7d2-ba4622f28fc6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:09:18.186781 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-05377896-279b-4816-ae82-f884e5da1c40 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '.version_select at 0x7f3a7827b0d0>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:18.291253 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-05377896-279b-4816-ae82-f884e5da1c40 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-741279528" status: 202 len: 0 microversion: 2.1 time: 0.109056 Sep 26 18:09:18.292062 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 312/639] 10.222.0.67 () {58 vars in 1218 bytes} [Mon Sep 26 18:09:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-741279528 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:09:18.718910 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-683909f2-b355-46c4-8786-dd7692fbec4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:18.719533 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-683909f2-b355-46c4-8786-dd7692fbec4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:18.727687 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-683909f2-b355-46c4-8786-dd7692fbec4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:18.728106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-683909f2-b355-46c4-8786-dd7692fbec4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:18.728545 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-683909f2-b355-46c4-8786-dd7692fbec4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:18.729261 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-683909f2-b355-46c4-8786-dd7692fbec4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:18.729712 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-683909f2-b355-46c4-8786-dd7692fbec4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:18.730348 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-683909f2-b355-46c4-8786-dd7692fbec4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:18.765546 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-683909f2-b355-46c4-8786-dd7692fbec4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:18.766035 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-683909f2-b355-46c4-8786-dd7692fbec4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:18.766590 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-683909f2-b355-46c4-8786-dd7692fbec4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:18.767075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-683909f2-b355-46c4-8786-dd7692fbec4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lazy-loading 'fault' on Instance uuid e8560d88-7c26-4e3c-8af6-aac7ac9aa390 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:09:18.838746 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-683909f2-b355-46c4-8786-dd7692fbec4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:18.849674 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-683909f2-b355-46c4-8786-dd7692fbec4c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 200 len: 1332 microversion: 2.1 time: 0.134705 Sep 26 18:09:18.850408 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 328/640] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:18 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 1332 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:19.884758 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e0afe787-95f5-4186-9dd1-47353b80ad9f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:19.885532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e0afe787-95f5-4186-9dd1-47353b80ad9f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:19.894154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e0afe787-95f5-4186-9dd1-47353b80ad9f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:19.894645 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e0afe787-95f5-4186-9dd1-47353b80ad9f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:19.895131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e0afe787-95f5-4186-9dd1-47353b80ad9f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:19.895869 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e0afe787-95f5-4186-9dd1-47353b80ad9f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:19.896329 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e0afe787-95f5-4186-9dd1-47353b80ad9f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:19.896748 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e0afe787-95f5-4186-9dd1-47353b80ad9f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:19.899788 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:19.912137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-e0afe787-95f5-4186-9dd1-47353b80ad9f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] HTTP exception thrown: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e0afe787-95f5-4186-9dd1-47353b80ad9f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Request method failure captured: Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 HTTP/1.1 Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMelsNex1FlD2CBY8G-ysnjsye_l-7KQaYKxzjq-uqqw_c6lt3XOkxaeXEOSBPxdrGfGNF6J_jwjGWJdIRzcPmWbMtwg-2UVrF8ghY8jl9NOGZb0sL_3XrXpF2FeqtmN-NjzE_b12zyopUCDg2jN5eXXFmLWv81UC7SHabJvYKq1cYR8 Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:09:19.913795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:09:19.915173 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:09:19.915173 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:09:19.915173 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:09:19.915173 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:09:19.915173 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:09:19.915173 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:09:19.915173 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:09:19.915173 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 0bede3a601f941e7abc9fd16983679b2 Sep 26 18:09:19.915173 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:09:19.915173 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:09:19.915173 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. Sep 26 18:09:19.915173 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': 'e8560d88-7c26-4e3c-8af6-aac7ac9aa390'} Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:09:19.916056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. Sep 26 18:09:19.918170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:09:19.920287 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e0afe787-95f5-4186-9dd1-47353b80ad9f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Returning 404 to user: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:09:19.920287 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e0afe787-95f5-4186-9dd1-47353b80ad9f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 404 len: 111 microversion: 2.1 time: 0.034504 Sep 26 18:09:19.920287 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 313/641] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:19 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:09:19.926385 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-183f7487-2f8a-45c4-b37c-b8f649a3f8c5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '.version_select at 0x7f3a74a90790>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:20.028661 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-183f7487-2f8a-45c4-b37c-b8f649a3f8c5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437785154" status: 202 len: 0 microversion: 2.1 time: 0.106876 Sep 26 18:09:20.029438 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 329/642] 10.222.0.67 () {58 vars in 1221 bytes} [Mon Sep 26 18:09:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437785154 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:09:20.981063 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-14d39110-e0e2-4090-84ed-1236adec39c9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Action: 'create', calling method: .version_select at 0x7f3a782bfaf0>, body: {"keypair": {"name": "tempest-keypair-1682308213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsSC4OMMGHklP9cD0eXFktcLBYexnfOSQfkpUwWAzrvFA8bTuDgjJoIJ5OyydGwUz570qW6zD1+JKFelEMOh0qlhDA4KJCnwIK1rWUSMKS38RcL7ly2+mehcDrji8fAJA=="}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:20.999224 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-14d39110-e0e2-4090-84ed-1236adec39c9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Getting quotas for project ffa58ff5197e48709d5c90ec334b9403. Resources: {'key_pairs'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:09:21.004249 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-14d39110-e0e2-4090-84ed-1236adec39c9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Getting quotas for user 0bede3a601f941e7abc9fd16983679b2 and project ffa58ff5197e48709d5c90ec334b9403. Resources: {'key_pairs'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:09:21.178111 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-14d39110-e0e2-4090-84ed-1236adec39c9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.200729 Sep 26 18:09:21.178603 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 314/643] 10.222.0.67 () {60 vars in 1159 bytes} [Mon Sep 26 18:09:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:09:22.165309 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-adde4bd9-9693-43be-9fda-60a14fd008db tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:22.166004 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-adde4bd9-9693-43be-9fda-60a14fd008db tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:22.175385 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-adde4bd9-9693-43be-9fda-60a14fd008db tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:22.176147 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-adde4bd9-9693-43be-9fda-60a14fd008db tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:22.176661 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-adde4bd9-9693-43be-9fda-60a14fd008db tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:22.177427 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-adde4bd9-9693-43be-9fda-60a14fd008db tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:22.178241 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-adde4bd9-9693-43be-9fda-60a14fd008db tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:22.178608 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-adde4bd9-9693-43be-9fda-60a14fd008db tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:22.216576 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-adde4bd9-9693-43be-9fda-60a14fd008db tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Going to try to terminate instance {{(pid=121029) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:09:22.626318 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-adde4bd9-9693-43be-9fda-60a14fd008db tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "DELETE /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 204 len: 0 microversion: 2.1 time: 0.465300 Sep 26 18:09:22.627900 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 330/644] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:09:22 2022] DELETE /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:09:22.637269 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-037b6193-16cd-4546-8ade-2e5227ca183c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:22.637867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-037b6193-16cd-4546-8ade-2e5227ca183c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:22.646140 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-037b6193-16cd-4546-8ade-2e5227ca183c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:22.646630 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-037b6193-16cd-4546-8ade-2e5227ca183c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:22.647068 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-037b6193-16cd-4546-8ade-2e5227ca183c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:22.647791 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-037b6193-16cd-4546-8ade-2e5227ca183c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:22.648243 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-037b6193-16cd-4546-8ade-2e5227ca183c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:22.648668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-037b6193-16cd-4546-8ade-2e5227ca183c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:22.795365 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-037b6193-16cd-4546-8ade-2e5227ca183c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:22.804358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-037b6193-16cd-4546-8ade-2e5227ca183c tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1506 microversion: 2.1 time: 0.171994 Sep 26 18:09:22.804959 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 315/645] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:22 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:23.834341 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d0e3472e-8ea9-4349-a14d-edd474b07720 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:23.835401 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d0e3472e-8ea9-4349-a14d-edd474b07720 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:23.844970 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d0e3472e-8ea9-4349-a14d-edd474b07720 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:23.846314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d0e3472e-8ea9-4349-a14d-edd474b07720 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:23.850196 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d0e3472e-8ea9-4349-a14d-edd474b07720 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:23.850196 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d0e3472e-8ea9-4349-a14d-edd474b07720 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:23.850196 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d0e3472e-8ea9-4349-a14d-edd474b07720 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:23.850196 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d0e3472e-8ea9-4349-a14d-edd474b07720 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:23.939285 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-601757295", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff0911ec-d0cb-47aa-9835-b96611526a51"}], "security_groups": [{"name": "tempest-securitygroup--552210455"}], "key_name": "tempest-keypair-1682308213", "user_data": "}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:23.999472 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d0e3472e-8ea9-4349-a14d-edd474b07720 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:24.007954 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d0e3472e-8ea9-4349-a14d-edd474b07720 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1506 microversion: 2.1 time: 0.180990 Sep 26 18:09:24.008528 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 331/646] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:23 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:24.056978 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.network.neutron [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] validate_networks() for [('ff0911ec-d0cb-47aa-9835-b96611526a51', None, None, None, None, None)] {{(pid=121028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:09:24.585882 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Flavor limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:09:24.586787 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Image limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:09:24.587733 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Flavor pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:09:24.588404 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Image pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:09:24.589229 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:09:24.604822 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:24.605588 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:24.606284 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:24.607455 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:24.608229 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:24.608903 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:24.635769 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Getting quotas for project ffa58ff5197e48709d5c90ec334b9403. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:09:24.640346 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Getting quotas for user 0bede3a601f941e7abc9fd16983679b2 and project ffa58ff5197e48709d5c90ec334b9403. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:09:24.656773 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Going to run 1 instances... {{(pid=121028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:09:24.659154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:09:24.797746 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-be253a3d-af2c-4d7e-92d7-626b7d06a55b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.864631 Sep 26 18:09:24.798651 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 316/647] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:09:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 18:09:24.812399 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d8fa0d22-d4e2-4ca3-9d5a-ba0585a0f43e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:24.813266 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d8fa0d22-d4e2-4ca3-9d5a-ba0585a0f43e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:25.037464 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1b560f5f-41f3-410b-b377-5f14f00945ca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:25.038083 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1b560f5f-41f3-410b-b377-5f14f00945ca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:25.052159 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1b560f5f-41f3-410b-b377-5f14f00945ca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:25.053068 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1b560f5f-41f3-410b-b377-5f14f00945ca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:25.053470 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1b560f5f-41f3-410b-b377-5f14f00945ca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:25.054646 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1b560f5f-41f3-410b-b377-5f14f00945ca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:25.055251 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1b560f5f-41f3-410b-b377-5f14f00945ca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:25.056129 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1b560f5f-41f3-410b-b377-5f14f00945ca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:25.089306 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d8fa0d22-d4e2-4ca3-9d5a-ba0585a0f43e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:25.099118 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d8fa0d22-d4e2-4ca3-9d5a-ba0585a0f43e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1241 microversion: 2.1 time: 0.291683 Sep 26 18:09:25.112971 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 332/648] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:24 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1241 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:25.275764 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1b560f5f-41f3-410b-b377-5f14f00945ca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:25.284388 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1b560f5f-41f3-410b-b377-5f14f00945ca tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1506 microversion: 2.1 time: 0.251003 Sep 26 18:09:25.284827 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 317/649] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:25 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:09:25.460716 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-c5932f90-2f37-47ca-812b-7fc7beeedbef req-6472871c-1e41-4795-aa7f-9c3dea8be0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220b1da2-7651-436f-ab85-1d16ee3ecea0", "name": "network-vif-deleted", "tag": "9ef108b0-8394-4e0e-8563-6390415fb8c4"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:25.475444 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-c5932f90-2f37-47ca-812b-7fc7beeedbef req-6472871c-1e41-4795-aa7f-9c3dea8be0c7 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:25.476363 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-c5932f90-2f37-47ca-812b-7fc7beeedbef req-6472871c-1e41-4795-aa7f-9c3dea8be0c7 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:25.481013 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-c5932f90-2f37-47ca-812b-7fc7beeedbef req-6472871c-1e41-4795-aa7f-9c3dea8be0c7 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:25.492350 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-c5932f90-2f37-47ca-812b-7fc7beeedbef req-6472871c-1e41-4795-aa7f-9c3dea8be0c7 service nova] Creating event network-vif-deleted:9ef108b0-8394-4e0e-8563-6390415fb8c4 for instance 220b1da2-7651-436f-ab85-1d16ee3ecea0 on hv-cinder-85931 Sep 26 18:09:25.497983 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-c5932f90-2f37-47ca-812b-7fc7beeedbef req-6472871c-1e41-4795-aa7f-9c3dea8be0c7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042221 Sep 26 18:09:25.499382 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 333/650] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:09:26.123129 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f5b16925-e5fc-456f-94c4-aaf3320d5615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:26.123917 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f5b16925-e5fc-456f-94c4-aaf3320d5615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:26.131251 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5b16925-e5fc-456f-94c4-aaf3320d5615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:26.131761 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5b16925-e5fc-456f-94c4-aaf3320d5615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:26.132365 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5b16925-e5fc-456f-94c4-aaf3320d5615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:26.133016 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5b16925-e5fc-456f-94c4-aaf3320d5615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:26.133467 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5b16925-e5fc-456f-94c4-aaf3320d5615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:26.133924 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5b16925-e5fc-456f-94c4-aaf3320d5615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:26.200450 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f5b16925-e5fc-456f-94c4-aaf3320d5615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:26.209483 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f5b16925-e5fc-456f-94c4-aaf3320d5615 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1245 microversion: 2.1 time: 0.090379 Sep 26 18:09:26.210071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 318/651] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:26 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:26.308373 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7358576e-a6cc-4c18-9825-70b37968604a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:26.308985 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7358576e-a6cc-4c18-9825-70b37968604a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:26.316609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7358576e-a6cc-4c18-9825-70b37968604a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:26.317097 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7358576e-a6cc-4c18-9825-70b37968604a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:26.317528 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7358576e-a6cc-4c18-9825-70b37968604a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:26.318221 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7358576e-a6cc-4c18-9825-70b37968604a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:26.318674 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7358576e-a6cc-4c18-9825-70b37968604a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:26.319091 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7358576e-a6cc-4c18-9825-70b37968604a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:26.354560 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7358576e-a6cc-4c18-9825-70b37968604a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:26.355037 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7358576e-a6cc-4c18-9825-70b37968604a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:26.355468 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7358576e-a6cc-4c18-9825-70b37968604a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:26.355960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-7358576e-a6cc-4c18-9825-70b37968604a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lazy-loading 'fault' on Instance uuid 220b1da2-7651-436f-ab85-1d16ee3ecea0 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:09:26.401469 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7358576e-a6cc-4c18-9825-70b37968604a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:26.407088 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7358576e-a6cc-4c18-9825-70b37968604a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 200 len: 1311 microversion: 2.1 time: 0.103648 Sep 26 18:09:26.407696 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 334/652] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:26 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:27.233367 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-08e7ebed-3b6e-4454-8ada-9a8f2ace8383 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:27.233998 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-08e7ebed-3b6e-4454-8ada-9a8f2ace8383 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:27.248486 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-08e7ebed-3b6e-4454-8ada-9a8f2ace8383 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:27.248486 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-08e7ebed-3b6e-4454-8ada-9a8f2ace8383 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:27.248486 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-08e7ebed-3b6e-4454-8ada-9a8f2ace8383 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:27.248486 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-08e7ebed-3b6e-4454-8ada-9a8f2ace8383 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:27.249315 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-08e7ebed-3b6e-4454-8ada-9a8f2ace8383 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:27.249315 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-08e7ebed-3b6e-4454-8ada-9a8f2ace8383 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:27.329787 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-08e7ebed-3b6e-4454-8ada-9a8f2ace8383 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:27.343580 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-08e7ebed-3b6e-4454-8ada-9a8f2ace8383 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1293 microversion: 2.1 time: 0.113169 Sep 26 18:09:27.344367 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 319/653] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:27 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1293 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:27.430678 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e38b1abe-fa6b-4bf1-9e13-e3057a954944 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:27.431400 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e38b1abe-fa6b-4bf1-9e13-e3057a954944 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: 220b1da2-7651-436f-ab85-1d16ee3ecea0] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:27.438027 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e38b1abe-fa6b-4bf1-9e13-e3057a954944 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:27.438510 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e38b1abe-fa6b-4bf1-9e13-e3057a954944 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:27.439097 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e38b1abe-fa6b-4bf1-9e13-e3057a954944 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:27.440390 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e38b1abe-fa6b-4bf1-9e13-e3057a954944 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:27.441237 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e38b1abe-fa6b-4bf1-9e13-e3057a954944 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:27.441672 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e38b1abe-fa6b-4bf1-9e13-e3057a954944 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:27.456776 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-e38b1abe-fa6b-4bf1-9e13-e3057a954944 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] HTTP exception thrown: Instance 220b1da2-7651-436f-ab85-1d16ee3ecea0 could not be found. Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e38b1abe-fa6b-4bf1-9e13-e3057a954944 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Request method failure captured: Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 HTTP/1.1 Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMelx-ipjEriwiSD7ibs9Z44BoWfZT3uyXwYPCzZ4uCB7LTqLOGaMmSnH6oOKtZayloye70yYnWFt5iXYcqgw8QZ2-eCL-Wz0unSbrK1_8M_uOgP8VNfV8jd2_jG5Mc5Zpq0az6KYot6uehZzTvsSYbg58zlBHSF8YA06MR56ri3H5AQ Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: 3a15ebd862054a64ac1d739db5adc3a2 Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1906646791 Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:09:27.458429 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:09:27.459975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:09:27.459975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1906646791 Sep 26 18:09:27.459975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: 3a15ebd862054a64ac1d739db5adc3a2 Sep 26 18:09:27.459975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1906646791 Sep 26 18:09:27.459975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-ServerRescueNegativeTestJSON-1906646791-project Sep 26 18:09:27.459975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:09:27.459975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:09:27.459975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 97ed136f68c540abbdaf04cbe34a682e Sep 26 18:09:27.459975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1906646791-project Sep 26 18:09:27.459975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:09:27.459975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance 220b1da2-7651-436f-ab85-1d16ee3ecea0 could not be found. Sep 26 18:09:27.459975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': '220b1da2-7651-436f-ab85-1d16ee3ecea0'} Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 220b1da2-7651-436f-ab85-1d16ee3ecea0 could not be found. Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:09:27.460884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 220b1da2-7651-436f-ab85-1d16ee3ecea0 could not be found. Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 220b1da2-7651-436f-ab85-1d16ee3ecea0 could not be found. Sep 26 18:09:27.462364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:27.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e38b1abe-fa6b-4bf1-9e13-e3057a954944 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Returning 404 to user: Instance 220b1da2-7651-436f-ab85-1d16ee3ecea0 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:09:27.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e38b1abe-fa6b-4bf1-9e13-e3057a954944 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0" status: 404 len: 111 microversion: 2.1 time: 0.033272 Sep 26 18:09:27.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 335/654] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:27 2022] GET /compute/v2.1/servers/220b1da2-7651-436f-ab85-1d16ee3ecea0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:09:27.472603 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a9221a4b-b90a-4afb-b002-760a7c231dc2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:27.473305 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a9221a4b-b90a-4afb-b002-760a7c231dc2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:27.481705 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a9221a4b-b90a-4afb-b002-760a7c231dc2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:27.482203 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a9221a4b-b90a-4afb-b002-760a7c231dc2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:27.482641 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a9221a4b-b90a-4afb-b002-760a7c231dc2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:27.483343 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a9221a4b-b90a-4afb-b002-760a7c231dc2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:27.483846 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a9221a4b-b90a-4afb-b002-760a7c231dc2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:27.484280 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a9221a4b-b90a-4afb-b002-760a7c231dc2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:27.511528 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a9221a4b-b90a-4afb-b002-760a7c231dc2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Going to try to terminate instance {{(pid=121028) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:09:27.883422 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a9221a4b-b90a-4afb-b002-760a7c231dc2 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 204 len: 0 microversion: 2.1 time: 0.417956 Sep 26 18:09:27.884040 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 320/655] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:09:27 2022] DELETE /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:09:27.893043 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-06708359-4ffa-4f9d-bff1-803f7ca8ffe0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:27.893809 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-06708359-4ffa-4f9d-bff1-803f7ca8ffe0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:27.900161 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-06708359-4ffa-4f9d-bff1-803f7ca8ffe0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:27.900676 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-06708359-4ffa-4f9d-bff1-803f7ca8ffe0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:27.901127 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-06708359-4ffa-4f9d-bff1-803f7ca8ffe0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:27.902113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-06708359-4ffa-4f9d-bff1-803f7ca8ffe0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:27.902570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-06708359-4ffa-4f9d-bff1-803f7ca8ffe0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:27.903338 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-06708359-4ffa-4f9d-bff1-803f7ca8ffe0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:28.042679 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-06708359-4ffa-4f9d-bff1-803f7ca8ffe0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:28.051002 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-06708359-4ffa-4f9d-bff1-803f7ca8ffe0 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.162771 Sep 26 18:09:28.051466 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 336/656] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:27 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:28.373381 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a1cf551b-5863-4ca0-9b07-375a3fea3290 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:28.374077 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a1cf551b-5863-4ca0-9b07-375a3fea3290 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:28.381231 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1cf551b-5863-4ca0-9b07-375a3fea3290 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:28.381731 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1cf551b-5863-4ca0-9b07-375a3fea3290 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:28.382177 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1cf551b-5863-4ca0-9b07-375a3fea3290 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:28.382879 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1cf551b-5863-4ca0-9b07-375a3fea3290 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:28.383342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1cf551b-5863-4ca0-9b07-375a3fea3290 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:28.383821 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1cf551b-5863-4ca0-9b07-375a3fea3290 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:28.448436 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a1cf551b-5863-4ca0-9b07-375a3fea3290 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:28.456204 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a1cf551b-5863-4ca0-9b07-375a3fea3290 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1301 microversion: 2.1 time: 0.087095 Sep 26 18:09:28.456778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 321/657] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:28 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:29.074435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-4f71385b-7bf9-4be6-ad74-705d2b175202 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:29.075096 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-4f71385b-7bf9-4be6-ad74-705d2b175202 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:29.082137 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4f71385b-7bf9-4be6-ad74-705d2b175202 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:29.082639 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4f71385b-7bf9-4be6-ad74-705d2b175202 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:29.083073 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4f71385b-7bf9-4be6-ad74-705d2b175202 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:29.083813 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4f71385b-7bf9-4be6-ad74-705d2b175202 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:29.084278 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4f71385b-7bf9-4be6-ad74-705d2b175202 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:29.084708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4f71385b-7bf9-4be6-ad74-705d2b175202 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:29.221089 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-4f71385b-7bf9-4be6-ad74-705d2b175202 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:29.228994 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-4f71385b-7bf9-4be6-ad74-705d2b175202 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.158592 Sep 26 18:09:29.229562 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 337/658] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:29 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:29.480856 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f560cf16-1a3b-4131-a472-9354c537fa35 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:29.481513 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f560cf16-1a3b-4131-a472-9354c537fa35 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:29.488725 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f560cf16-1a3b-4131-a472-9354c537fa35 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:29.489204 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f560cf16-1a3b-4131-a472-9354c537fa35 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:29.489635 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f560cf16-1a3b-4131-a472-9354c537fa35 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:29.490347 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f560cf16-1a3b-4131-a472-9354c537fa35 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:29.490795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f560cf16-1a3b-4131-a472-9354c537fa35 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:29.491209 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f560cf16-1a3b-4131-a472-9354c537fa35 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:29.559008 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f560cf16-1a3b-4131-a472-9354c537fa35 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:29.567900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f560cf16-1a3b-4131-a472-9354c537fa35 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1301 microversion: 2.1 time: 0.090741 Sep 26 18:09:29.568486 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 322/659] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:29 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:30.253763 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bbd945b6-35f2-433e-a79e-5ee7eff3ee7a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:30.254609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-bbd945b6-35f2-433e-a79e-5ee7eff3ee7a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:30.260388 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbd945b6-35f2-433e-a79e-5ee7eff3ee7a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:30.260876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbd945b6-35f2-433e-a79e-5ee7eff3ee7a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:30.261311 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbd945b6-35f2-433e-a79e-5ee7eff3ee7a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:30.262003 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbd945b6-35f2-433e-a79e-5ee7eff3ee7a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:30.262462 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbd945b6-35f2-433e-a79e-5ee7eff3ee7a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:30.262888 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbd945b6-35f2-433e-a79e-5ee7eff3ee7a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:30.396549 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bbd945b6-35f2-433e-a79e-5ee7eff3ee7a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:30.404451 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bbd945b6-35f2-433e-a79e-5ee7eff3ee7a tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.155898 Sep 26 18:09:30.405017 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 338/660] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:30 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:30.591002 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6dab2e77-2c5b-448c-b2fa-9efbda76251f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:30.591586 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-6dab2e77-2c5b-448c-b2fa-9efbda76251f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:30.598862 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6dab2e77-2c5b-448c-b2fa-9efbda76251f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:30.599345 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6dab2e77-2c5b-448c-b2fa-9efbda76251f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:30.599807 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6dab2e77-2c5b-448c-b2fa-9efbda76251f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:30.600495 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6dab2e77-2c5b-448c-b2fa-9efbda76251f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:30.600949 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6dab2e77-2c5b-448c-b2fa-9efbda76251f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:30.601367 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6dab2e77-2c5b-448c-b2fa-9efbda76251f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:30.671461 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6dab2e77-2c5b-448c-b2fa-9efbda76251f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:30.680400 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-6dab2e77-2c5b-448c-b2fa-9efbda76251f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1301 microversion: 2.1 time: 0.093407 Sep 26 18:09:30.680986 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 323/661] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:30 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:31.428520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a120cae9-b63c-44d5-983d-6858de084a5e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:31.429271 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a120cae9-b63c-44d5-983d-6858de084a5e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:31.435873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a120cae9-b63c-44d5-983d-6858de084a5e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:31.436371 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a120cae9-b63c-44d5-983d-6858de084a5e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:31.436815 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a120cae9-b63c-44d5-983d-6858de084a5e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:31.437512 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a120cae9-b63c-44d5-983d-6858de084a5e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:31.437972 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a120cae9-b63c-44d5-983d-6858de084a5e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:31.438398 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a120cae9-b63c-44d5-983d-6858de084a5e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:31.699437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a120cae9-b63c-44d5-983d-6858de084a5e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:31.707191 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-91e5d0aa-e9d5-4fee-8e27-b15700129141 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:31.707875 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-91e5d0aa-e9d5-4fee-8e27-b15700129141 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:31.708490 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a120cae9-b63c-44d5-983d-6858de084a5e tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1520 microversion: 2.1 time: 0.283973 Sep 26 18:09:31.709077 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 339/662] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:31 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:31.715213 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-91e5d0aa-e9d5-4fee-8e27-b15700129141 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:31.715842 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-91e5d0aa-e9d5-4fee-8e27-b15700129141 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:31.716273 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-91e5d0aa-e9d5-4fee-8e27-b15700129141 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:31.716992 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-91e5d0aa-e9d5-4fee-8e27-b15700129141 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:31.717514 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-91e5d0aa-e9d5-4fee-8e27-b15700129141 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:31.717932 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-91e5d0aa-e9d5-4fee-8e27-b15700129141 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:31.865295 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-91e5d0aa-e9d5-4fee-8e27-b15700129141 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:31.874474 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-91e5d0aa-e9d5-4fee-8e27-b15700129141 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1299 microversion: 2.1 time: 0.171898 Sep 26 18:09:31.875211 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 324/663] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:31 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:31.931062 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-06645549-83e4-4950-b7d9-fc8ab70f533a req-7ad8ed0b-cb86-4cc0-a3b6-a090965ab135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92dd8f8-d04b-4fb0-804a-8842bd4c60c9", "name": "network-vif-deleted", "tag": "88eb2714-0a5c-49b3-aebb-0b129916ee37"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:31.941548 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-06645549-83e4-4950-b7d9-fc8ab70f533a req-7ad8ed0b-cb86-4cc0-a3b6-a090965ab135 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:31.942112 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-06645549-83e4-4950-b7d9-fc8ab70f533a req-7ad8ed0b-cb86-4cc0-a3b6-a090965ab135 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:31.942612 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-06645549-83e4-4950-b7d9-fc8ab70f533a req-7ad8ed0b-cb86-4cc0-a3b6-a090965ab135 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:31.963716 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-06645549-83e4-4950-b7d9-fc8ab70f533a req-7ad8ed0b-cb86-4cc0-a3b6-a090965ab135 service nova] Creating event network-vif-deleted:88eb2714-0a5c-49b3-aebb-0b129916ee37 for instance f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 on hv-cinder-85931 Sep 26 18:09:31.963716 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-06645549-83e4-4950-b7d9-fc8ab70f533a req-7ad8ed0b-cb86-4cc0-a3b6-a090965ab135 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032026 Sep 26 18:09:31.963716 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 340/664] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:09:32.731315 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8f562294-fbcf-49d7-9370-8708a514ee02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:32.731931 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-8f562294-fbcf-49d7-9370-8708a514ee02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:32.739237 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8f562294-fbcf-49d7-9370-8708a514ee02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:32.739745 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8f562294-fbcf-49d7-9370-8708a514ee02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:32.740182 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8f562294-fbcf-49d7-9370-8708a514ee02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:32.740876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8f562294-fbcf-49d7-9370-8708a514ee02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:32.741358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8f562294-fbcf-49d7-9370-8708a514ee02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:32.741782 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8f562294-fbcf-49d7-9370-8708a514ee02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:32.771163 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:32.774855 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8f562294-fbcf-49d7-9370-8708a514ee02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:32.775339 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8f562294-fbcf-49d7-9370-8708a514ee02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:32.775811 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8f562294-fbcf-49d7-9370-8708a514ee02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:32.776252 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-8f562294-fbcf-49d7-9370-8708a514ee02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lazy-loading 'fault' on Instance uuid f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:09:32.819311 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8f562294-fbcf-49d7-9370-8708a514ee02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ed136f68c540abbdaf04cbe34a682e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a15ebd862054a64ac1d739db5adc3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:32.826960 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8f562294-fbcf-49d7-9370-8708a514ee02 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 200 len: 1310 microversion: 2.1 time: 0.099520 Sep 26 18:09:32.827514 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 325/665] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:32 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:32.903760 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-510cc1b6-47a8-463b-9af3-e1a9e5a255ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:32.904457 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-510cc1b6-47a8-463b-9af3-e1a9e5a255ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:32.911334 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-510cc1b6-47a8-463b-9af3-e1a9e5a255ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:32.911857 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-510cc1b6-47a8-463b-9af3-e1a9e5a255ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:32.916612 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-510cc1b6-47a8-463b-9af3-e1a9e5a255ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:32.916612 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-510cc1b6-47a8-463b-9af3-e1a9e5a255ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:32.916612 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-510cc1b6-47a8-463b-9af3-e1a9e5a255ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:32.916612 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-510cc1b6-47a8-463b-9af3-e1a9e5a255ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:33.137288 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-510cc1b6-47a8-463b-9af3-e1a9e5a255ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:33.146463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-510cc1b6-47a8-463b-9af3-e1a9e5a255ed tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1366 microversion: 2.1 time: 0.247497 Sep 26 18:09:33.147037 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 341/666] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:32 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:33.852820 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-37626eae-850a-44bd-b286-f778ef7a0482 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:33.853440 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-37626eae-850a-44bd-b286-f778ef7a0482 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] [instance: f92dd8f8-d04b-4fb0-804a-8842bd4c60c9] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:33.860311 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-37626eae-850a-44bd-b286-f778ef7a0482 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:33.860797 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-37626eae-850a-44bd-b286-f778ef7a0482 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:33.861780 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-37626eae-850a-44bd-b286-f778ef7a0482 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:33.862690 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-37626eae-850a-44bd-b286-f778ef7a0482 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:33.863347 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-37626eae-850a-44bd-b286-f778ef7a0482 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:33.863732 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-37626eae-850a-44bd-b286-f778ef7a0482 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:33.881066 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-37626eae-850a-44bd-b286-f778ef7a0482 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] HTTP exception thrown: Instance f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 could not be found. Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-37626eae-850a-44bd-b286-f778ef7a0482 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Request method failure captured: Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 HTTP/1.1 Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMelx-ipjEriwiSD7ibs9Z44BoWfZT3uyXwYPCzZ4uCB7LTqLOGaMmSnH6oOKtZayloye70yYnWFt5iXYcqgw8QZ2-eCL-Wz0unSbrK1_8M_uOgP8VNfV8jd2_jG5Mc5Zpq0az6KYot6uehZzTvsSYbg58zlBHSF8YA06MR56ri3H5AQ Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 3a15ebd862054a64ac1d739db5adc3a2 Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1906646791 Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:09:33.882786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:09:33.884125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3a15ebd862054a64ac1d739db5adc3a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:09:33.884125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1906646791 Sep 26 18:09:33.884125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 3a15ebd862054a64ac1d739db5adc3a2 Sep 26 18:09:33.884125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1906646791 Sep 26 18:09:33.884125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-ServerRescueNegativeTestJSON-1906646791-project Sep 26 18:09:33.884125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:09:33.884125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:09:33.884125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 97ed136f68c540abbdaf04cbe34a682e Sep 26 18:09:33.884125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1906646791-project Sep 26 18:09:33.884125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:09:33.884125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 could not be found. Sep 26 18:09:33.884125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': 'f92dd8f8-d04b-4fb0-804a-8842bd4c60c9'} Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 could not be found. Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:09:33.884852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 could not be found. Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 could not be found. Sep 26 18:09:33.886032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:09:33.887062 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-37626eae-850a-44bd-b286-f778ef7a0482 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] Returning 404 to user: Instance f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:09:33.887062 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-37626eae-850a-44bd-b286-f778ef7a0482 tempest-ServerRescueNegativeTestJSON-1906646791 tempest-ServerRescueNegativeTestJSON-1906646791-project] 10.222.0.67 "GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9" status: 404 len: 111 microversion: 2.1 time: 0.035613 Sep 26 18:09:33.887062 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 326/667] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:33 2022] GET /compute/v2.1/servers/f92dd8f8-d04b-4fb0-804a-8842bd4c60c9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:09:33.952523 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7fd649a3-c97b-4ca5-9c8b-3fa1b9c69f97 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:33.953107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7fd649a3-c97b-4ca5-9c8b-3fa1b9c69f97 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:33.959396 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7fd649a3-c97b-4ca5-9c8b-3fa1b9c69f97 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:33.960408 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7fd649a3-c97b-4ca5-9c8b-3fa1b9c69f97 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:33.960665 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7fd649a3-c97b-4ca5-9c8b-3fa1b9c69f97 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:33.961497 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7fd649a3-c97b-4ca5-9c8b-3fa1b9c69f97 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:33.961949 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7fd649a3-c97b-4ca5-9c8b-3fa1b9c69f97 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:33.962368 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7fd649a3-c97b-4ca5-9c8b-3fa1b9c69f97 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:33.988575 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-cd15e44a-dad0-4c45-94c4-774601aff677 req-bbef738c-74f5-4626-800e-4c9a48da3f51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a049820-82bd-4c41-8047-5f4fa2d9966e", "tag": "0c54af98-0db2-4ce1-9deb-71251c9bce73"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:34.005625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-cd15e44a-dad0-4c45-94c4-774601aff677 req-bbef738c-74f5-4626-800e-4c9a48da3f51 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:34.006279 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-cd15e44a-dad0-4c45-94c4-774601aff677 req-bbef738c-74f5-4626-800e-4c9a48da3f51 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:34.008070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-cd15e44a-dad0-4c45-94c4-774601aff677 req-bbef738c-74f5-4626-800e-4c9a48da3f51 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:34.020462 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-cd15e44a-dad0-4c45-94c4-774601aff677 req-bbef738c-74f5-4626-800e-4c9a48da3f51 service nova] Creating event network-changed:0c54af98-0db2-4ce1-9deb-71251c9bce73 for instance 7a049820-82bd-4c41-8047-5f4fa2d9966e on hv-cinder-85931 Sep 26 18:09:34.026723 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7fd649a3-c97b-4ca5-9c8b-3fa1b9c69f97 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/os-volume_attachments/f70e362b-24c6-48f8-bb22-865e6b949c3d" status: 200 len: 194 microversion: 2.20 time: 0.078799 Sep 26 18:09:34.027585 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 342/668] 10.222.0.67 () {60 vars in 1454 bytes} [Mon Sep 26 18:09:33 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/os-volume_attachments/f70e362b-24c6-48f8-bb22-865e6b949c3d => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 18:09:34.029049 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-cd15e44a-dad0-4c45-94c4-774601aff677 req-bbef738c-74f5-4626-800e-4c9a48da3f51 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045186 Sep 26 18:09:34.029759 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 327/669] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:09:34.105402 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-350f89b5-feca-41bb-b2ba-852312f647f5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:34.105402 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-350f89b5-feca-41bb-b2ba-852312f647f5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:34.110896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-350f89b5-feca-41bb-b2ba-852312f647f5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:34.112322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-350f89b5-feca-41bb-b2ba-852312f647f5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:34.112787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-350f89b5-feca-41bb-b2ba-852312f647f5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:34.113502 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-350f89b5-feca-41bb-b2ba-852312f647f5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:34.113966 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-350f89b5-feca-41bb-b2ba-852312f647f5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:34.114399 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-350f89b5-feca-41bb-b2ba-852312f647f5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:34.171901 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-79713c03-b9d4-45ec-bd40-94b7c4a303e5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:34.173625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-79713c03-b9d4-45ec-bd40-94b7c4a303e5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:34.183913 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-79713c03-b9d4-45ec-bd40-94b7c4a303e5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:34.183913 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-79713c03-b9d4-45ec-bd40-94b7c4a303e5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:34.183913 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-79713c03-b9d4-45ec-bd40-94b7c4a303e5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:34.184937 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-79713c03-b9d4-45ec-bd40-94b7c4a303e5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:34.185605 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-79713c03-b9d4-45ec-bd40-94b7c4a303e5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:34.186259 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-79713c03-b9d4-45ec-bd40-94b7c4a303e5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:34.196146 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:34.202239 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-350f89b5-feca-41bb-b2ba-852312f647f5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lazy-loading 'services' on Instance uuid f6298d28-8cba-46d8-a809-bd0f81e18d58 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:09:34.350386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-79713c03-b9d4-45ec-bd40-94b7c4a303e5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:34.358276 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-79713c03-b9d4-45ec-bd40-94b7c4a303e5 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1366 microversion: 2.1 time: 0.191232 Sep 26 18:09:34.358846 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 328/670] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:34 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:34.546120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-350f89b5-feca-41bb-b2ba-852312f647f5 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/os-volume_attachments/f70e362b-24c6-48f8-bb22-865e6b949c3d" status: 202 len: 0 microversion: 2.20 time: 0.445412 Sep 26 18:09:34.546703 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 343/671] 10.222.0.67 () {60 vars in 1457 bytes} [Mon Sep 26 18:09:34 2022] DELETE /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/os-volume_attachments/f70e362b-24c6-48f8-bb22-865e6b949c3d => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:09:34.556241 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f6042eb1-4fb3-4f38-af2f-35bdabbc918d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:34.558535 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f6042eb1-4fb3-4f38-af2f-35bdabbc918d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:34.565568 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f6042eb1-4fb3-4f38-af2f-35bdabbc918d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:34.566305 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f6042eb1-4fb3-4f38-af2f-35bdabbc918d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:34.566886 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f6042eb1-4fb3-4f38-af2f-35bdabbc918d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:34.567693 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f6042eb1-4fb3-4f38-af2f-35bdabbc918d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:34.568236 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f6042eb1-4fb3-4f38-af2f-35bdabbc918d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:34.568728 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f6042eb1-4fb3-4f38-af2f-35bdabbc918d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:34.600608 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f6042eb1-4fb3-4f38-af2f-35bdabbc918d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048611 Sep 26 18:09:34.601089 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 329/672] 10.222.0.67 () {60 vars in 1343 bytes} [Mon Sep 26 18:09:34 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 18:09:35.384239 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9131227e-e1f5-44da-b4bd-aa1bdf45bff3 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:35.385070 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9131227e-e1f5-44da-b4bd-aa1bdf45bff3 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:35.388856 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:35.393655 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9131227e-e1f5-44da-b4bd-aa1bdf45bff3 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:35.394404 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9131227e-e1f5-44da-b4bd-aa1bdf45bff3 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:35.395039 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9131227e-e1f5-44da-b4bd-aa1bdf45bff3 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:35.396232 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9131227e-e1f5-44da-b4bd-aa1bdf45bff3 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:35.396882 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9131227e-e1f5-44da-b4bd-aa1bdf45bff3 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:35.397323 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9131227e-e1f5-44da-b4bd-aa1bdf45bff3 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:35.545255 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9131227e-e1f5-44da-b4bd-aa1bdf45bff3 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:35.554131 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9131227e-e1f5-44da-b4bd-aa1bdf45bff3 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1366 microversion: 2.1 time: 0.174455 Sep 26 18:09:35.554701 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 344/673] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:35 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:35.614833 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ec530a16-9425-49c4-9772-fa67182bdd93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:35.617085 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ec530a16-9425-49c4-9772-fa67182bdd93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:35.619209 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=2 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:35.619927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=10 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:35.625180 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ec530a16-9425-49c4-9772-fa67182bdd93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:35.625662 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ec530a16-9425-49c4-9772-fa67182bdd93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:35.631052 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ec530a16-9425-49c4-9772-fa67182bdd93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:35.631052 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ec530a16-9425-49c4-9772-fa67182bdd93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:35.631052 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ec530a16-9425-49c4-9772-fa67182bdd93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:35.631052 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ec530a16-9425-49c4-9772-fa67182bdd93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:35.662152 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ec530a16-9425-49c4-9772-fa67182bdd93 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052232 Sep 26 18:09:35.665341 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 330/674] 10.222.0.67 () {60 vars in 1343 bytes} [Mon Sep 26 18:09:35 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 18:09:36.577515 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d873b57f-d613-4cee-bf19-407acea0b826 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:36.578101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d873b57f-d613-4cee-bf19-407acea0b826 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:36.584735 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d873b57f-d613-4cee-bf19-407acea0b826 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:36.585222 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d873b57f-d613-4cee-bf19-407acea0b826 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:36.585655 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d873b57f-d613-4cee-bf19-407acea0b826 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:36.586348 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d873b57f-d613-4cee-bf19-407acea0b826 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:36.586804 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d873b57f-d613-4cee-bf19-407acea0b826 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:36.587229 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d873b57f-d613-4cee-bf19-407acea0b826 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:36.679092 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-bcb5f6eb-9255-482e-8a3e-1a4d7d7ffb98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:36.681456 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-bcb5f6eb-9255-482e-8a3e-1a4d7d7ffb98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:36.688989 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bcb5f6eb-9255-482e-8a3e-1a4d7d7ffb98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:36.690014 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bcb5f6eb-9255-482e-8a3e-1a4d7d7ffb98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:36.690754 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bcb5f6eb-9255-482e-8a3e-1a4d7d7ffb98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:36.691469 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bcb5f6eb-9255-482e-8a3e-1a4d7d7ffb98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:36.692127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bcb5f6eb-9255-482e-8a3e-1a4d7d7ffb98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:36.692632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bcb5f6eb-9255-482e-8a3e-1a4d7d7ffb98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:36.708549 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:36.728847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-bcb5f6eb-9255-482e-8a3e-1a4d7d7ffb98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053058 Sep 26 18:09:36.734644 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 331/675] 10.222.0.67 () {60 vars in 1343 bytes} [Mon Sep 26 18:09:36 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:36.737995 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d873b57f-d613-4cee-bf19-407acea0b826 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:36.747811 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d873b57f-d613-4cee-bf19-407acea0b826 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1366 microversion: 2.1 time: 0.174145 Sep 26 18:09:36.759683 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 345/676] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:36 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:36.821319 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b625dfee-cecf-4494-899a-1da337749d6b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:36.821319 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b625dfee-cecf-4494-899a-1da337749d6b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:36.826841 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b625dfee-cecf-4494-899a-1da337749d6b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:36.827335 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b625dfee-cecf-4494-899a-1da337749d6b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:36.827857 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b625dfee-cecf-4494-899a-1da337749d6b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:36.828722 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b625dfee-cecf-4494-899a-1da337749d6b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:36.829188 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b625dfee-cecf-4494-899a-1da337749d6b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:36.829609 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b625dfee-cecf-4494-899a-1da337749d6b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:36.858869 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b625dfee-cecf-4494-899a-1da337749d6b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Going to try to terminate instance {{(pid=121028) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:09:37.413895 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b625dfee-cecf-4494-899a-1da337749d6b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 204 len: 0 microversion: 2.20 time: 0.600057 Sep 26 18:09:37.421288 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 332/677] 10.222.0.67 () {60 vars in 1280 bytes} [Mon Sep 26 18:09:36 2022] DELETE /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 18:09:37.425299 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9439d427-1664-43c4-96a3-531c3adbb889 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:37.426223 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9439d427-1664-43c4-96a3-531c3adbb889 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:37.434907 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9439d427-1664-43c4-96a3-531c3adbb889 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:37.435541 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9439d427-1664-43c4-96a3-531c3adbb889 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:37.436170 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9439d427-1664-43c4-96a3-531c3adbb889 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:37.437019 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9439d427-1664-43c4-96a3-531c3adbb889 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:37.437581 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9439d427-1664-43c4-96a3-531c3adbb889 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:37.438111 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9439d427-1664-43c4-96a3-531c3adbb889 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:37.699238 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9439d427-1664-43c4-96a3-531c3adbb889 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:37.711716 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9439d427-1664-43c4-96a3-531c3adbb889 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:37.713175 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9439d427-1664-43c4-96a3-531c3adbb889 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:37.714358 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9439d427-1664-43c4-96a3-531c3adbb889 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.294998 Sep 26 18:09:37.714917 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 346/678] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:09:37 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:09:37.782078 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1ba44875-f4af-443d-a358-e324dc9eb3ca tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:37.783101 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1ba44875-f4af-443d-a358-e324dc9eb3ca tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:37.792461 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1ba44875-f4af-443d-a358-e324dc9eb3ca tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:37.793018 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1ba44875-f4af-443d-a358-e324dc9eb3ca tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:37.796180 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1ba44875-f4af-443d-a358-e324dc9eb3ca tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:37.796180 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1ba44875-f4af-443d-a358-e324dc9eb3ca tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:37.796180 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1ba44875-f4af-443d-a358-e324dc9eb3ca tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:37.796180 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1ba44875-f4af-443d-a358-e324dc9eb3ca tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:37.996636 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1ba44875-f4af-443d-a358-e324dc9eb3ca tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:38.005360 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1ba44875-f4af-443d-a358-e324dc9eb3ca tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1366 microversion: 2.1 time: 0.231759 Sep 26 18:09:38.005949 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 333/679] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:37 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:38.743345 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f245d6e9-fca3-451a-bff9-9f21f4650f80 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:38.743979 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f245d6e9-fca3-451a-bff9-9f21f4650f80 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:38.750724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f245d6e9-fca3-451a-bff9-9f21f4650f80 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:38.751211 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f245d6e9-fca3-451a-bff9-9f21f4650f80 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:38.751727 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f245d6e9-fca3-451a-bff9-9f21f4650f80 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:38.752446 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f245d6e9-fca3-451a-bff9-9f21f4650f80 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:38.752913 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f245d6e9-fca3-451a-bff9-9f21f4650f80 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:38.753322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f245d6e9-fca3-451a-bff9-9f21f4650f80 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:38.893600 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f245d6e9-fca3-451a-bff9-9f21f4650f80 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:38.902373 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f245d6e9-fca3-451a-bff9-9f21f4650f80 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:38.904052 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f245d6e9-fca3-451a-bff9-9f21f4650f80 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:38.905289 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f245d6e9-fca3-451a-bff9-9f21f4650f80 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.165870 Sep 26 18:09:38.905925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 347/680] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:09:38 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:09:39.029774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-173c4e74-0279-4263-914a-9ee62c6d3a00 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:39.030421 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-173c4e74-0279-4263-914a-9ee62c6d3a00 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:39.039864 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-173c4e74-0279-4263-914a-9ee62c6d3a00 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:39.040579 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-173c4e74-0279-4263-914a-9ee62c6d3a00 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:39.041234 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-173c4e74-0279-4263-914a-9ee62c6d3a00 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:39.041978 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-173c4e74-0279-4263-914a-9ee62c6d3a00 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:39.042632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-173c4e74-0279-4263-914a-9ee62c6d3a00 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:39.043080 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-173c4e74-0279-4263-914a-9ee62c6d3a00 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:39.184148 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-173c4e74-0279-4263-914a-9ee62c6d3a00 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:39.192442 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-173c4e74-0279-4263-914a-9ee62c6d3a00 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1366 microversion: 2.1 time: 0.166581 Sep 26 18:09:39.193288 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 334/681] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:39 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:39.931837 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-dac4d6f5-23f3-436c-a827-625aa9d5897c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:39.932386 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-dac4d6f5-23f3-436c-a827-625aa9d5897c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:39.939072 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dac4d6f5-23f3-436c-a827-625aa9d5897c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:39.940452 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dac4d6f5-23f3-436c-a827-625aa9d5897c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:39.941070 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dac4d6f5-23f3-436c-a827-625aa9d5897c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:39.941776 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dac4d6f5-23f3-436c-a827-625aa9d5897c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:39.942235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dac4d6f5-23f3-436c-a827-625aa9d5897c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:39.942662 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dac4d6f5-23f3-436c-a827-625aa9d5897c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:40.128576 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-dac4d6f5-23f3-436c-a827-625aa9d5897c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:40.137331 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-dac4d6f5-23f3-436c-a827-625aa9d5897c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:40.138766 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-dac4d6f5-23f3-436c-a827-625aa9d5897c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:40.139955 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-dac4d6f5-23f3-436c-a827-625aa9d5897c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1723 microversion: 2.20 time: 0.212220 Sep 26 18:09:40.140774 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 348/682] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:09:39 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:09:40.225982 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d113cf31-e760-40d3-adb2-501b6ddf17c7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:40.227482 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d113cf31-e760-40d3-adb2-501b6ddf17c7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:40.234603 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d113cf31-e760-40d3-adb2-501b6ddf17c7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:40.235149 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d113cf31-e760-40d3-adb2-501b6ddf17c7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:40.235607 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d113cf31-e760-40d3-adb2-501b6ddf17c7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:40.236930 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d113cf31-e760-40d3-adb2-501b6ddf17c7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:40.237558 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d113cf31-e760-40d3-adb2-501b6ddf17c7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:40.238248 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d113cf31-e760-40d3-adb2-501b6ddf17c7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:40.777330 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d113cf31-e760-40d3-adb2-501b6ddf17c7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:40.794829 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d113cf31-e760-40d3-adb2-501b6ddf17c7 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1366 microversion: 2.1 time: 0.571298 Sep 26 18:09:40.807880 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 335/683] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:40 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1366 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:40.829390 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-5a9c5c2a-85f7-42c3-9780-33cae398e8f7 req-9165f4f1-a9ee-4f10-820f-bdc1ec24fa3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a049820-82bd-4c41-8047-5f4fa2d9966e", "name": "network-vif-plugged", "status": "completed", "tag": "0c54af98-0db2-4ce1-9deb-71251c9bce73"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:40.839765 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-5a9c5c2a-85f7-42c3-9780-33cae398e8f7 req-9165f4f1-a9ee-4f10-820f-bdc1ec24fa3b service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:40.840344 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-5a9c5c2a-85f7-42c3-9780-33cae398e8f7 req-9165f4f1-a9ee-4f10-820f-bdc1ec24fa3b service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:40.840691 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-5a9c5c2a-85f7-42c3-9780-33cae398e8f7 req-9165f4f1-a9ee-4f10-820f-bdc1ec24fa3b service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:40.853296 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-5a9c5c2a-85f7-42c3-9780-33cae398e8f7 req-9165f4f1-a9ee-4f10-820f-bdc1ec24fa3b service nova] Creating event network-vif-plugged:0c54af98-0db2-4ce1-9deb-71251c9bce73 for instance 7a049820-82bd-4c41-8047-5f4fa2d9966e on hv-cinder-85931 Sep 26 18:09:40.858281 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-5a9c5c2a-85f7-42c3-9780-33cae398e8f7 req-9165f4f1-a9ee-4f10-820f-bdc1ec24fa3b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.252861 Sep 26 18:09:40.863427 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 349/684] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:09:40.973828 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-4cf036b6-affc-45f4-8494-07f312713a4f req-3b232f4e-4c0d-436c-b856-81ae6d7b1cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6298d28-8cba-46d8-a809-bd0f81e18d58", "name": "network-vif-deleted", "tag": "a14f5b04-fe69-47de-b23e-8ff9f06a4aae"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:40.988279 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-4cf036b6-affc-45f4-8494-07f312713a4f req-3b232f4e-4c0d-436c-b856-81ae6d7b1cde service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:40.988767 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-4cf036b6-affc-45f4-8494-07f312713a4f req-3b232f4e-4c0d-436c-b856-81ae6d7b1cde service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:40.989197 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-4cf036b6-affc-45f4-8494-07f312713a4f req-3b232f4e-4c0d-436c-b856-81ae6d7b1cde service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:41.005131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-4cf036b6-affc-45f4-8494-07f312713a4f req-3b232f4e-4c0d-436c-b856-81ae6d7b1cde service nova] Creating event network-vif-deleted:a14f5b04-fe69-47de-b23e-8ff9f06a4aae for instance f6298d28-8cba-46d8-a809-bd0f81e18d58 on hv-cinder-85931 Sep 26 18:09:41.010718 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-4cf036b6-affc-45f4-8494-07f312713a4f req-3b232f4e-4c0d-436c-b856-81ae6d7b1cde service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041873 Sep 26 18:09:41.011553 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 336/685] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:09:41.168723 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8cc2392a-5e7a-423c-82ef-0ed642e3bcf9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:41.170122 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-8cc2392a-5e7a-423c-82ef-0ed642e3bcf9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:41.179456 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8cc2392a-5e7a-423c-82ef-0ed642e3bcf9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:41.180018 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8cc2392a-5e7a-423c-82ef-0ed642e3bcf9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:41.180656 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8cc2392a-5e7a-423c-82ef-0ed642e3bcf9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:41.182108 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8cc2392a-5e7a-423c-82ef-0ed642e3bcf9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:41.182108 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8cc2392a-5e7a-423c-82ef-0ed642e3bcf9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:41.182342 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8cc2392a-5e7a-423c-82ef-0ed642e3bcf9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:41.254355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-8cc2392a-5e7a-423c-82ef-0ed642e3bcf9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:41.264020 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-8cc2392a-5e7a-423c-82ef-0ed642e3bcf9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:41.266617 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-8cc2392a-5e7a-423c-82ef-0ed642e3bcf9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:41.268684 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-8cc2392a-5e7a-423c-82ef-0ed642e3bcf9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1367 microversion: 2.20 time: 0.105509 Sep 26 18:09:41.269722 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 350/686] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:09:41 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1367 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:09:41.826488 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b4444cbe-3cd5-4dc7-9eb3-90462db33fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:41.827562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b4444cbe-3cd5-4dc7-9eb3-90462db33fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:41.847178 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4444cbe-3cd5-4dc7-9eb3-90462db33fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:41.847178 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4444cbe-3cd5-4dc7-9eb3-90462db33fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:41.847178 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4444cbe-3cd5-4dc7-9eb3-90462db33fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:41.847577 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4444cbe-3cd5-4dc7-9eb3-90462db33fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:41.847703 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4444cbe-3cd5-4dc7-9eb3-90462db33fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:41.848110 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4444cbe-3cd5-4dc7-9eb3-90462db33fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:42.006048 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b4444cbe-3cd5-4dc7-9eb3-90462db33fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:42.014421 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b4444cbe-3cd5-4dc7-9eb3-90462db33fae tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1366 microversion: 2.1 time: 0.196349 Sep 26 18:09:42.015246 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 337/687] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:41 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:42.294935 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5ce9432a-0b3f-4695-bda8-5b566cf2dca4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:42.295693 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-5ce9432a-0b3f-4695-bda8-5b566cf2dca4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:42.298273 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:42.303637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5ce9432a-0b3f-4695-bda8-5b566cf2dca4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:42.304232 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5ce9432a-0b3f-4695-bda8-5b566cf2dca4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:42.304767 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5ce9432a-0b3f-4695-bda8-5b566cf2dca4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:42.305532 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5ce9432a-0b3f-4695-bda8-5b566cf2dca4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:42.306068 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5ce9432a-0b3f-4695-bda8-5b566cf2dca4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:42.306596 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5ce9432a-0b3f-4695-bda8-5b566cf2dca4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:42.340547 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5ce9432a-0b3f-4695-bda8-5b566cf2dca4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:42.341015 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5ce9432a-0b3f-4695-bda8-5b566cf2dca4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:42.341515 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5ce9432a-0b3f-4695-bda8-5b566cf2dca4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:42.342486 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-5ce9432a-0b3f-4695-bda8-5b566cf2dca4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lazy-loading 'fault' on Instance uuid f6298d28-8cba-46d8-a809-bd0f81e18d58 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:09:42.385093 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5ce9432a-0b3f-4695-bda8-5b566cf2dca4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:42.396127 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5ce9432a-0b3f-4695-bda8-5b566cf2dca4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:42.397495 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5ce9432a-0b3f-4695-bda8-5b566cf2dca4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:42.398698 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5ce9432a-0b3f-4695-bda8-5b566cf2dca4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1372 microversion: 2.20 time: 0.108055 Sep 26 18:09:42.399248 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 351/688] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:09:42 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:09:43.039971 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-90a7c9c3-cf96-45e6-b462-86c8526df74c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:43.041240 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-90a7c9c3-cf96-45e6-b462-86c8526df74c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:43.047730 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-90a7c9c3-cf96-45e6-b462-86c8526df74c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:43.048988 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-90a7c9c3-cf96-45e6-b462-86c8526df74c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:43.049426 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-90a7c9c3-cf96-45e6-b462-86c8526df74c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:43.050128 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-90a7c9c3-cf96-45e6-b462-86c8526df74c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:43.050574 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-90a7c9c3-cf96-45e6-b462-86c8526df74c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:43.051160 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-90a7c9c3-cf96-45e6-b462-86c8526df74c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:43.252917 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-90a7c9c3-cf96-45e6-b462-86c8526df74c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:43.265312 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-90a7c9c3-cf96-45e6-b462-86c8526df74c tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1556 microversion: 2.1 time: 0.229461 Sep 26 18:09:43.266416 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 338/689] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:43 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1556 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:43.293600 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bf927ba8-fcbf-49a6-86fd-b14af4b7aeba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:43.293600 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-bf927ba8-fcbf-49a6-86fd-b14af4b7aeba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:43.301060 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bf927ba8-fcbf-49a6-86fd-b14af4b7aeba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:43.301739 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bf927ba8-fcbf-49a6-86fd-b14af4b7aeba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:43.302231 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bf927ba8-fcbf-49a6-86fd-b14af4b7aeba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:43.303061 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bf927ba8-fcbf-49a6-86fd-b14af4b7aeba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:43.303617 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bf927ba8-fcbf-49a6-86fd-b14af4b7aeba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:43.304209 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bf927ba8-fcbf-49a6-86fd-b14af4b7aeba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:43.391944 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bf927ba8-fcbf-49a6-86fd-b14af4b7aeba tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104993 Sep 26 18:09:43.398839 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 352/690] 10.222.0.67 () {58 vars in 1275 bytes} [Mon Sep 26 18:09:43 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:09:43.424589 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-25eec1f0-6da2-4814-912c-9282b51b3ce9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:43.430005 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-25eec1f0-6da2-4814-912c-9282b51b3ce9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:43.443496 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-25eec1f0-6da2-4814-912c-9282b51b3ce9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:43.444328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-25eec1f0-6da2-4814-912c-9282b51b3ce9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:43.444947 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-25eec1f0-6da2-4814-912c-9282b51b3ce9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:43.445668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-25eec1f0-6da2-4814-912c-9282b51b3ce9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:43.446129 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-25eec1f0-6da2-4814-912c-9282b51b3ce9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:43.446597 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-25eec1f0-6da2-4814-912c-9282b51b3ce9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:43.480771 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-25eec1f0-6da2-4814-912c-9282b51b3ce9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:43.481324 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-25eec1f0-6da2-4814-912c-9282b51b3ce9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:43.481857 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-25eec1f0-6da2-4814-912c-9282b51b3ce9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:43.482314 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-25eec1f0-6da2-4814-912c-9282b51b3ce9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lazy-loading 'fault' on Instance uuid f6298d28-8cba-46d8-a809-bd0f81e18d58 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:09:43.533929 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-25eec1f0-6da2-4814-912c-9282b51b3ce9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:43.547618 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-25eec1f0-6da2-4814-912c-9282b51b3ce9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:43.558241 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-25eec1f0-6da2-4814-912c-9282b51b3ce9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:43.558241 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-25eec1f0-6da2-4814-912c-9282b51b3ce9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 200 len: 1372 microversion: 2.20 time: 0.131611 Sep 26 18:09:43.558241 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 339/691] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:09:43 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 1372 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:09:44.587986 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bec8b1f1-b9d7-42d2-aadf-389f814862e1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:44.589311 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-bec8b1f1-b9d7-42d2-aadf-389f814862e1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:44.598031 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bec8b1f1-b9d7-42d2-aadf-389f814862e1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:44.598874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bec8b1f1-b9d7-42d2-aadf-389f814862e1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:44.599525 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bec8b1f1-b9d7-42d2-aadf-389f814862e1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:44.600377 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bec8b1f1-b9d7-42d2-aadf-389f814862e1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:44.600950 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bec8b1f1-b9d7-42d2-aadf-389f814862e1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:44.601478 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bec8b1f1-b9d7-42d2-aadf-389f814862e1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:44.621503 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-bec8b1f1-b9d7-42d2-aadf-389f814862e1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] HTTP exception thrown: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bec8b1f1-b9d7-42d2-aadf-389f814862e1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Request method failure captured: Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 HTTP/1.1 Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMenrtk5tq13JBXVAzsMWnII01d7pczbpHO-Wh5dDgiQyfwVHwgJOAbHWwWhF7ai29v3_EegLdtL6MVLOB7qy_dLjjIXLuW0WRpc0k6HHsT7j9UrX9GK3Tzj3LdzplQ9GocPQ4OAzK-C23LAV0H9Y_uWHFbzxwxAVd9muaG-Gjibyhvw Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: f6595854cfb04a11994c6aed8f5857c6 Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:09:44.623439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:09:44.624948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:09:44.624948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:09:44.624948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: f6595854cfb04a11994c6aed8f5857c6 Sep 26 18:09:44.624948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:09:44.624948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-AttachVolumeShelveTestJSON-1964894886-project Sep 26 18:09:44.624948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:09:44.624948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:09:44.624948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 612875c8fc7240e5b18fe38a034a3ef5 Sep 26 18:09:44.624948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1964894886-project Sep 26 18:09:44.624948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:09:44.624948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. Sep 26 18:09:44.624948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': 'f6298d28-8cba-46d8-a809-bd0f81e18d58'} Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:09:44.625717 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. Sep 26 18:09:44.627500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:09:44.630182 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bec8b1f1-b9d7-42d2-aadf-389f814862e1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Returning 404 to user: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:09:44.631713 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bec8b1f1-b9d7-42d2-aadf-389f814862e1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 404 len: 111 microversion: 2.20 time: 0.048649 Sep 26 18:09:44.636173 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 353/692] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:09:44 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 18:09:44.642369 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-60d85f1d-c413-4fd1-8694-55a5adcfa926 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '.version_select at 0x7f3a74a2e0d0>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:44.766018 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-60d85f1d-c413-4fd1-8694-55a5adcfa926 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1740863839" status: 204 len: 0 microversion: 2.20 time: 0.128373 Sep 26 18:09:44.771976 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 340/693] 10.222.0.67 () {60 vars in 1262 bytes} [Mon Sep 26 18:09:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1740863839 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 18:09:45.151626 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-a5259f8f-21ca-4ad5-bc45-7f8451215219 req-e9abaf1a-37a2-4eca-8eb1-cdf5ae9bb605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a049820-82bd-4c41-8047-5f4fa2d9966e", "tag": "0c54af98-0db2-4ce1-9deb-71251c9bce73"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:45.176606 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-a5259f8f-21ca-4ad5-bc45-7f8451215219 req-e9abaf1a-37a2-4eca-8eb1-cdf5ae9bb605 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:45.177097 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-a5259f8f-21ca-4ad5-bc45-7f8451215219 req-e9abaf1a-37a2-4eca-8eb1-cdf5ae9bb605 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:45.177528 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-a5259f8f-21ca-4ad5-bc45-7f8451215219 req-e9abaf1a-37a2-4eca-8eb1-cdf5ae9bb605 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:45.191149 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-a5259f8f-21ca-4ad5-bc45-7f8451215219 req-e9abaf1a-37a2-4eca-8eb1-cdf5ae9bb605 service nova] Creating event network-changed:0c54af98-0db2-4ce1-9deb-71251c9bce73 for instance 7a049820-82bd-4c41-8047-5f4fa2d9966e on hv-cinder-85931 Sep 26 18:09:45.197029 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-a5259f8f-21ca-4ad5-bc45-7f8451215219 req-e9abaf1a-37a2-4eca-8eb1-cdf5ae9bb605 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248926 Sep 26 18:09:45.200997 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 354/694] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:09:46.318787 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-616e69ad-346f-4d61-8df4-87433e2d3675 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Action: 'create', calling method: .version_select at 0x7f3a7828c160>, body: {"keypair": {"name": "tempest-keypair-421030644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAERJTXJFULKZXVwjwtDjkX3slcJ5SVhdbJWTgNm1tfkd/nKM+ojpuZ/1cZazX6X2hNfSt3hALEQt/pyln3u8xCxgjj95rKm35qX5FNkKXRRNMXL93hw2eumWWyUnSVjew=="}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:46.368351 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-616e69ad-346f-4d61-8df4-87433e2d3675 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Getting quotas for project f6595854cfb04a11994c6aed8f5857c6. Resources: {'key_pairs'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:09:46.374402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-616e69ad-346f-4d61-8df4-87433e2d3675 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Getting quotas for user 612875c8fc7240e5b18fe38a034a3ef5 and project f6595854cfb04a11994c6aed8f5857c6. Resources: {'key_pairs'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:09:46.531130 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-616e69ad-346f-4d61-8df4-87433e2d3675 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.219491 Sep 26 18:09:46.531612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 341/695] 10.222.0.67 () {62 vars in 1200 bytes} [Mon Sep 26 18:09:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 221 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 26 18:09:48.515405 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b2c98d21-8316-43d2-9fa9-f2b17c7efdca tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Action: 'create', calling method: .version_select at 0x7f3a75a05160>, body: {"keypair": {"name": "tempest-keypair-218979986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZTUXR6zZNlgrULeljwJ5IYoShXaw1QZ8ZlQZqDhzguHWS+mzoOkIo5yUU7SA98vR2Cpvza4JOfQHVESmAM856DHMjJaLQ524Q+yB5yjzn5VpIO2XinousLtnMnAUhV4A=="}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:48.532570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-b2c98d21-8316-43d2-9fa9-f2b17c7efdca tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Getting quotas for project 7750acf9ab4843d1a3848472e99881a1. Resources: {'key_pairs'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:09:48.537984 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-b2c98d21-8316-43d2-9fa9-f2b17c7efdca tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Getting quotas for user 4b1cdc37455c489fb45e1ce3e2421cc0 and project 7750acf9ab4843d1a3848472e99881a1. Resources: {'key_pairs'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:09:48.692232 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b2c98d21-8316-43d2-9fa9-f2b17c7efdca tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.247700 Sep 26 18:09:48.692919 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 355/696] 10.222.0.67 () {60 vars in 1159 bytes} [Mon Sep 26 18:09:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:09:50.097182 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1817283191", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce568303-84c8-4c5c-8d2c-8e418731567a"}], "security_groups": [{"name": "tempest-securitygroup--1253362464"}], "key_name": "tempest-keypair-421030644", "user_data": "}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:50.274496 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.network.neutron [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] validate_networks() for [('ce568303-84c8-4c5c-8d2c-8e418731567a', None, None, None, None, None)] {{(pid=121028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:09:51.239919 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Flavor limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:09:51.240554 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Image limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:09:51.240816 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Flavor pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:09:51.241228 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Image pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:09:51.246298 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:09:51.253479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:51.254216 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:51.254392 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:51.255131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:51.255592 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:51.256073 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:51.286194 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Getting quotas for project f6595854cfb04a11994c6aed8f5857c6. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:09:51.309212 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Getting quotas for user 612875c8fc7240e5b18fe38a034a3ef5 and project f6595854cfb04a11994c6aed8f5857c6. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:09:51.326565 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Going to run 1 instances... {{(pid=121028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:09:51.330498 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:09:51.555228 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-bc28747f-4ae4-47b1-9120-f23eae79fa7d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.471066 Sep 26 18:09:51.556262 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 342/697] 10.222.0.67 () {62 vars in 1188 bytes} [Mon Sep 26 18:09:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1476 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 26 18:09:51.570855 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-96fdd5a8-99af-4954-9edf-7b04f21b3368 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:51.573349 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-96fdd5a8-99af-4954-9edf-7b04f21b3368 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:51.677592 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-96fdd5a8-99af-4954-9edf-7b04f21b3368 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:51.688827 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-96fdd5a8-99af-4954-9edf-7b04f21b3368 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:51.690876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-96fdd5a8-99af-4954-9edf-7b04f21b3368 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:51.692068 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-96fdd5a8-99af-4954-9edf-7b04f21b3368 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1281 microversion: 2.20 time: 0.126205 Sep 26 18:09:51.707985 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 356/698] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:09:51 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1281 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:09:52.245870 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1484861680", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cfb449ba-f5c1-48f2-86e2-66ac0c50a443"}], "security_groups": [{"name": "tempest-securitygroup--1958674504"}], "key_name": "tempest-keypair-218979986", "user_data": "}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:52.406362 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.network.neutron [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] validate_networks() for [('cfb449ba-f5c1-48f2-86e2-66ac0c50a443', None, None, None, None, None)] {{(pid=121028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:09:52.727025 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7c0e6c5a-2e95-4202-a85d-18289a4a53e3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:52.727914 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7c0e6c5a-2e95-4202-a85d-18289a4a53e3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:52.832799 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7c0e6c5a-2e95-4202-a85d-18289a4a53e3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:52.842701 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7c0e6c5a-2e95-4202-a85d-18289a4a53e3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:52.844684 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7c0e6c5a-2e95-4202-a85d-18289a4a53e3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:52.846623 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7c0e6c5a-2e95-4202-a85d-18289a4a53e3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1281 microversion: 2.20 time: 0.123858 Sep 26 18:09:52.847233 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 357/699] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:09:52 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1281 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:09:53.000851 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Flavor limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:09:53.002138 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Image limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:09:53.003462 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Flavor pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:09:53.013516 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Image pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:09:53.013516 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:09:53.021046 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:53.021881 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:53.022635 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:53.023833 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:53.024673 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:53.025608 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:53.051251 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Getting quotas for project 7750acf9ab4843d1a3848472e99881a1. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:09:53.055761 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Getting quotas for user 4b1cdc37455c489fb45e1ce3e2421cc0 and project 7750acf9ab4843d1a3848472e99881a1. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:09:53.068302 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Going to run 1 instances... {{(pid=121028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:09:53.070488 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:09:53.249521 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a7b2c44f-04e4-4237-8995-9043ab6cd010 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.011644 Sep 26 18:09:53.250629 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 343/700] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:09:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:09:53.264450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ee3e5af5-11f1-4ca1-9a69-153a040de087 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:53.265251 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ee3e5af5-11f1-4ca1-9a69-153a040de087 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:53.335710 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ee3e5af5-11f1-4ca1-9a69-153a040de087 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:53.346795 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ee3e5af5-11f1-4ca1-9a69-153a040de087 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1237 microversion: 2.1 time: 0.086619 Sep 26 18:09:53.348146 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 358/701] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:53 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:53.874528 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-22ddcb88-99f1-40cc-bec9-e06f128a4e51 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:53.880231 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-22ddcb88-99f1-40cc-bec9-e06f128a4e51 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:53.883952 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-22ddcb88-99f1-40cc-bec9-e06f128a4e51 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:53.884480 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-22ddcb88-99f1-40cc-bec9-e06f128a4e51 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:53.888662 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-22ddcb88-99f1-40cc-bec9-e06f128a4e51 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:53.888662 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-22ddcb88-99f1-40cc-bec9-e06f128a4e51 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:53.888662 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-22ddcb88-99f1-40cc-bec9-e06f128a4e51 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:53.888662 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-22ddcb88-99f1-40cc-bec9-e06f128a4e51 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:53.952583 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-22ddcb88-99f1-40cc-bec9-e06f128a4e51 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:53.961608 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-22ddcb88-99f1-40cc-bec9-e06f128a4e51 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:53.963025 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-22ddcb88-99f1-40cc-bec9-e06f128a4e51 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:53.964194 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-22ddcb88-99f1-40cc-bec9-e06f128a4e51 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1333 microversion: 2.20 time: 0.096456 Sep 26 18:09:53.964749 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 344/702] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:09:53 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:09:54.371814 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7f34170f-261e-4af7-a6fc-61e25126626a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:54.372654 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7f34170f-261e-4af7-a6fc-61e25126626a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:54.476912 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7f34170f-261e-4af7-a6fc-61e25126626a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:54.487242 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7f34170f-261e-4af7-a6fc-61e25126626a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1237 microversion: 2.1 time: 0.118439 Sep 26 18:09:54.488380 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 359/703] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:54 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1237 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:09:54.991330 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b1785bb7-09f6-46d5-bae2-179e5e4e210e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:54.998831 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b1785bb7-09f6-46d5-bae2-179e5e4e210e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:55.005129 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1785bb7-09f6-46d5-bae2-179e5e4e210e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:55.005748 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1785bb7-09f6-46d5-bae2-179e5e4e210e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:55.006285 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1785bb7-09f6-46d5-bae2-179e5e4e210e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:55.008864 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1785bb7-09f6-46d5-bae2-179e5e4e210e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:55.009398 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1785bb7-09f6-46d5-bae2-179e5e4e210e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:55.010001 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1785bb7-09f6-46d5-bae2-179e5e4e210e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:55.093245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b1785bb7-09f6-46d5-bae2-179e5e4e210e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:55.106807 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b1785bb7-09f6-46d5-bae2-179e5e4e210e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:55.109047 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b1785bb7-09f6-46d5-bae2-179e5e4e210e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:55.110633 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b1785bb7-09f6-46d5-bae2-179e5e4e210e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1339 microversion: 2.20 time: 0.124351 Sep 26 18:09:55.111985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 345/704] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:09:54 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1339 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:09:55.529151 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c18a05aa-494b-4cf0-b2d1-1b0d8d8ba3e5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:55.530055 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c18a05aa-494b-4cf0-b2d1-1b0d8d8ba3e5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:55.532220 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:55.541166 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c18a05aa-494b-4cf0-b2d1-1b0d8d8ba3e5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:55.542754 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c18a05aa-494b-4cf0-b2d1-1b0d8d8ba3e5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:55.543368 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c18a05aa-494b-4cf0-b2d1-1b0d8d8ba3e5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:55.548689 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c18a05aa-494b-4cf0-b2d1-1b0d8d8ba3e5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:55.548689 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c18a05aa-494b-4cf0-b2d1-1b0d8d8ba3e5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:55.548689 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c18a05aa-494b-4cf0-b2d1-1b0d8d8ba3e5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:55.620215 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c18a05aa-494b-4cf0-b2d1-1b0d8d8ba3e5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:55.631034 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c18a05aa-494b-4cf0-b2d1-1b0d8d8ba3e5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1289 microversion: 2.1 time: 0.109154 Sep 26 18:09:55.631633 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 360/705] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:55 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1289 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:09:56.153688 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a1b97132-e75a-4ac0-a325-4fa43c1544a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:56.154488 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a1b97132-e75a-4ac0-a325-4fa43c1544a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:56.162491 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1b97132-e75a-4ac0-a325-4fa43c1544a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:56.162986 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1b97132-e75a-4ac0-a325-4fa43c1544a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:56.163421 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1b97132-e75a-4ac0-a325-4fa43c1544a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:56.164251 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1b97132-e75a-4ac0-a325-4fa43c1544a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:56.164715 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1b97132-e75a-4ac0-a325-4fa43c1544a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:56.165145 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a1b97132-e75a-4ac0-a325-4fa43c1544a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:56.554651 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a1b97132-e75a-4ac0-a325-4fa43c1544a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:56.586820 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a1b97132-e75a-4ac0-a325-4fa43c1544a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:56.588869 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a1b97132-e75a-4ac0-a325-4fa43c1544a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:56.590106 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a1b97132-e75a-4ac0-a325-4fa43c1544a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1407 microversion: 2.20 time: 0.440422 Sep 26 18:09:56.590900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 346/706] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:09:56 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:09:56.658650 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9d8032ba-c084-430a-affc-8544c7270928 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:56.660013 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9d8032ba-c084-430a-affc-8544c7270928 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:56.679073 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9d8032ba-c084-430a-affc-8544c7270928 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:56.679577 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9d8032ba-c084-430a-affc-8544c7270928 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:56.680048 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9d8032ba-c084-430a-affc-8544c7270928 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:56.683763 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9d8032ba-c084-430a-affc-8544c7270928 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:56.683763 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9d8032ba-c084-430a-affc-8544c7270928 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:56.683763 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9d8032ba-c084-430a-affc-8544c7270928 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:56.797733 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9d8032ba-c084-430a-affc-8544c7270928 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:56.810856 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9d8032ba-c084-430a-affc-8544c7270928 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1307 microversion: 2.1 time: 0.156989 Sep 26 18:09:56.812050 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 361/707] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:56 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1307 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:09:57.446350 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-e03182dc-f432-4f1c-8d8b-912097c84d9c req-c7428a87-37e1-414b-b2f3-813bf009cb79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157c830f-c695-4a1a-a21f-1d0d6c24dd93", "tag": "4810d7ad-3670-4d57-835a-ea0d6344ef48"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:57.457221 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-e03182dc-f432-4f1c-8d8b-912097c84d9c req-c7428a87-37e1-414b-b2f3-813bf009cb79 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:57.457698 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-e03182dc-f432-4f1c-8d8b-912097c84d9c req-c7428a87-37e1-414b-b2f3-813bf009cb79 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:57.458131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-e03182dc-f432-4f1c-8d8b-912097c84d9c req-c7428a87-37e1-414b-b2f3-813bf009cb79 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:57.471078 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-e03182dc-f432-4f1c-8d8b-912097c84d9c req-c7428a87-37e1-414b-b2f3-813bf009cb79 service nova] Creating event network-changed:4810d7ad-3670-4d57-835a-ea0d6344ef48 for instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 on hv-cinder-85931 Sep 26 18:09:57.479758 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-e03182dc-f432-4f1c-8d8b-912097c84d9c req-c7428a87-37e1-414b-b2f3-813bf009cb79 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036986 Sep 26 18:09:57.480396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 347/708] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:09:57.625813 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b1aa758f-c8c5-463b-b1e6-68674e529c76 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:57.627116 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b1aa758f-c8c5-463b-b1e6-68674e529c76 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:57.639690 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1aa758f-c8c5-463b-b1e6-68674e529c76 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:57.640540 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1aa758f-c8c5-463b-b1e6-68674e529c76 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:57.641599 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1aa758f-c8c5-463b-b1e6-68674e529c76 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:57.642973 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1aa758f-c8c5-463b-b1e6-68674e529c76 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:57.643929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1aa758f-c8c5-463b-b1e6-68674e529c76 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:57.645062 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b1aa758f-c8c5-463b-b1e6-68674e529c76 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:57.844973 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-88201b40-3a69-4399-a133-a2539ed55cde tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:57.846491 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-88201b40-3a69-4399-a133-a2539ed55cde tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:57.854246 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-88201b40-3a69-4399-a133-a2539ed55cde tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:57.854944 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-88201b40-3a69-4399-a133-a2539ed55cde tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:57.855508 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-88201b40-3a69-4399-a133-a2539ed55cde tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:57.856388 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-88201b40-3a69-4399-a133-a2539ed55cde tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:57.856950 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-88201b40-3a69-4399-a133-a2539ed55cde tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:57.857474 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-88201b40-3a69-4399-a133-a2539ed55cde tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:57.944214 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b1aa758f-c8c5-463b-b1e6-68674e529c76 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:57.960590 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b1aa758f-c8c5-463b-b1e6-68674e529c76 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:57.963854 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b1aa758f-c8c5-463b-b1e6-68674e529c76 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:57.966147 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b1aa758f-c8c5-463b-b1e6-68674e529c76 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1407 microversion: 2.20 time: 0.349016 Sep 26 18:09:57.967570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 362/709] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:09:57 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:09:58.011514 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-88201b40-3a69-4399-a133-a2539ed55cde tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:58.022562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-88201b40-3a69-4399-a133-a2539ed55cde tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1295 microversion: 2.1 time: 0.181689 Sep 26 18:09:58.023181 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 348/710] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:57 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1295 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:09:59.007636 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-18a3da03-dfdc-451c-87a9-10fc522e72b8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:59.008865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-18a3da03-dfdc-451c-87a9-10fc522e72b8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:59.019060 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-18a3da03-dfdc-451c-87a9-10fc522e72b8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:59.019574 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-18a3da03-dfdc-451c-87a9-10fc522e72b8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:59.020085 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-18a3da03-dfdc-451c-87a9-10fc522e72b8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:59.020853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-18a3da03-dfdc-451c-87a9-10fc522e72b8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:59.021319 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-18a3da03-dfdc-451c-87a9-10fc522e72b8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:59.021750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-18a3da03-dfdc-451c-87a9-10fc522e72b8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:59.067209 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2c47e6c0-eb89-4416-bfe2-a7b5b574759a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:09:59.068570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2c47e6c0-eb89-4416-bfe2-a7b5b574759a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:59.073938 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:59.079330 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2c47e6c0-eb89-4416-bfe2-a7b5b574759a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:59.081623 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2c47e6c0-eb89-4416-bfe2-a7b5b574759a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:59.082363 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2c47e6c0-eb89-4416-bfe2-a7b5b574759a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:59.083588 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2c47e6c0-eb89-4416-bfe2-a7b5b574759a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:59.084416 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2c47e6c0-eb89-4416-bfe2-a7b5b574759a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:59.085103 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2c47e6c0-eb89-4416-bfe2-a7b5b574759a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:59.310627 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-18a3da03-dfdc-451c-87a9-10fc522e72b8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:59.321970 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-18a3da03-dfdc-451c-87a9-10fc522e72b8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:59.323957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-18a3da03-dfdc-451c-87a9-10fc522e72b8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:59.325346 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-18a3da03-dfdc-451c-87a9-10fc522e72b8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1407 microversion: 2.20 time: 0.324414 Sep 26 18:09:59.326183 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 363/711] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:09:58 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:09:59.430806 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2c47e6c0-eb89-4416-bfe2-a7b5b574759a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:09:59.444808 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2c47e6c0-eb89-4416-bfe2-a7b5b574759a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1363 microversion: 2.1 time: 0.387392 Sep 26 18:09:59.446057 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 349/712] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:09:59 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1363 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:09:59.731329 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-baaa27c0-5c8d-45dd-8bdb-4583fbb69ba3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:59.731929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-baaa27c0-5c8d-45dd-8bdb-4583fbb69ba3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:09:59.739058 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-baaa27c0-5c8d-45dd-8bdb-4583fbb69ba3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:59.739597 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-baaa27c0-5c8d-45dd-8bdb-4583fbb69ba3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:59.740102 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-baaa27c0-5c8d-45dd-8bdb-4583fbb69ba3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:59.740834 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-baaa27c0-5c8d-45dd-8bdb-4583fbb69ba3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:59.741338 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-baaa27c0-5c8d-45dd-8bdb-4583fbb69ba3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:59.741800 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-baaa27c0-5c8d-45dd-8bdb-4583fbb69ba3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:59.766255 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-baaa27c0-5c8d-45dd-8bdb-4583fbb69ba3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lazy-loading 'flavor' on Instance uuid b19e1622-6521-459d-9db1-80abd4bcf0f8 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:09:59.800551 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-b294bff3-6243-4a33-b5ae-9976ac95bf14 req-e0c930d9-f894-4a09-85d8-8ad306828297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7369614f-dc83-49a8-b16c-2c2189b1e9db", "tag": "555a4990-c7e3-456c-b0c7-7742d6f81240"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:09:59.812253 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-b294bff3-6243-4a33-b5ae-9976ac95bf14 req-e0c930d9-f894-4a09-85d8-8ad306828297 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:09:59.812837 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-b294bff3-6243-4a33-b5ae-9976ac95bf14 req-e0c930d9-f894-4a09-85d8-8ad306828297 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:09:59.813444 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-b294bff3-6243-4a33-b5ae-9976ac95bf14 req-e0c930d9-f894-4a09-85d8-8ad306828297 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:09:59.828984 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-b294bff3-6243-4a33-b5ae-9976ac95bf14 req-e0c930d9-f894-4a09-85d8-8ad306828297 service nova] Creating event network-changed:555a4990-c7e3-456c-b0c7-7742d6f81240 for instance 7369614f-dc83-49a8-b16c-2c2189b1e9db on hv-cinder-85931 Sep 26 18:09:59.835133 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-b294bff3-6243-4a33-b5ae-9976ac95bf14 req-e0c930d9-f894-4a09-85d8-8ad306828297 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039045 Sep 26 18:09:59.835869 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 350/713] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:10:00.149753 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-baaa27c0-5c8d-45dd-8bdb-4583fbb69ba3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "POST /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8/action" status: 202 len: 0 microversion: 2.1 time: 0.421787 Sep 26 18:10:00.150775 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 364/714] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Sep 26 18:09:59 2022] POST /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:10:00.163615 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8fcf1b4e-059c-40df-88a3-53f935027bb4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:00.164501 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-8fcf1b4e-059c-40df-88a3-53f935027bb4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:00.178365 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8fcf1b4e-059c-40df-88a3-53f935027bb4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:00.178855 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8fcf1b4e-059c-40df-88a3-53f935027bb4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:00.179761 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8fcf1b4e-059c-40df-88a3-53f935027bb4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:00.180862 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8fcf1b4e-059c-40df-88a3-53f935027bb4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:00.181601 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8fcf1b4e-059c-40df-88a3-53f935027bb4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:00.182556 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8fcf1b4e-059c-40df-88a3-53f935027bb4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:00.211501 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:00.372526 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7eb4956d-85e9-4360-8785-f25151c5ef8b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:00.373647 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7eb4956d-85e9-4360-8785-f25151c5ef8b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:00.384520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7eb4956d-85e9-4360-8785-f25151c5ef8b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:00.385312 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7eb4956d-85e9-4360-8785-f25151c5ef8b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:00.385974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7eb4956d-85e9-4360-8785-f25151c5ef8b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:00.387106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7eb4956d-85e9-4360-8785-f25151c5ef8b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:00.387882 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7eb4956d-85e9-4360-8785-f25151c5ef8b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:00.388556 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7eb4956d-85e9-4360-8785-f25151c5ef8b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:00.813322 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8fcf1b4e-059c-40df-88a3-53f935027bb4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:00.828225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8fcf1b4e-059c-40df-88a3-53f935027bb4 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1569 microversion: 2.1 time: 0.672041 Sep 26 18:10:00.829816 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 351/715] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:00 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1569 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:10:00.837901 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c23a2b01-b5bc-4783-92a2-1ad592c754d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:00.838970 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c23a2b01-b5bc-4783-92a2-1ad592c754d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:00.849583 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c23a2b01-b5bc-4783-92a2-1ad592c754d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:00.850437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c23a2b01-b5bc-4783-92a2-1ad592c754d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:00.851198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c23a2b01-b5bc-4783-92a2-1ad592c754d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:00.852446 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c23a2b01-b5bc-4783-92a2-1ad592c754d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:00.853258 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c23a2b01-b5bc-4783-92a2-1ad592c754d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:00.854018 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c23a2b01-b5bc-4783-92a2-1ad592c754d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:00.970229 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7eb4956d-85e9-4360-8785-f25151c5ef8b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:00.980920 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7eb4956d-85e9-4360-8785-f25151c5ef8b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:00.983468 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7eb4956d-85e9-4360-8785-f25151c5ef8b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:00.985493 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7eb4956d-85e9-4360-8785-f25151c5ef8b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1407 microversion: 2.20 time: 0.619469 Sep 26 18:10:00.999678 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 365/716] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:10:00 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1407 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:10:01.122577 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c23a2b01-b5bc-4783-92a2-1ad592c754d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:01.136387 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c23a2b01-b5bc-4783-92a2-1ad592c754d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1363 microversion: 2.1 time: 0.305292 Sep 26 18:10:01.137323 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 352/717] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:00 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:01.867768 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ccf4ad04-6a09-4c3d-aabd-3e585aafe590 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:01.868603 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ccf4ad04-6a09-4c3d-aabd-3e585aafe590 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:01.875505 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ccf4ad04-6a09-4c3d-aabd-3e585aafe590 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:01.876057 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ccf4ad04-6a09-4c3d-aabd-3e585aafe590 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:01.877159 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ccf4ad04-6a09-4c3d-aabd-3e585aafe590 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:01.877910 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ccf4ad04-6a09-4c3d-aabd-3e585aafe590 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:01.878479 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ccf4ad04-6a09-4c3d-aabd-3e585aafe590 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:01.878923 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ccf4ad04-6a09-4c3d-aabd-3e585aafe590 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:02.022471 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-609f2358-2ae3-4d89-8a57-58e8d1249264 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:02.023093 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-609f2358-2ae3-4d89-8a57-58e8d1249264 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:02.029816 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-609f2358-2ae3-4d89-8a57-58e8d1249264 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:02.030320 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-609f2358-2ae3-4d89-8a57-58e8d1249264 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:02.030828 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-609f2358-2ae3-4d89-8a57-58e8d1249264 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:02.031448 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-609f2358-2ae3-4d89-8a57-58e8d1249264 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:02.031944 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-609f2358-2ae3-4d89-8a57-58e8d1249264 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:02.032360 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-609f2358-2ae3-4d89-8a57-58e8d1249264 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:02.041012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ccf4ad04-6a09-4c3d-aabd-3e585aafe590 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:02.055793 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ccf4ad04-6a09-4c3d-aabd-3e585aafe590 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1569 microversion: 2.1 time: 0.191678 Sep 26 18:10:02.056793 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 366/718] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:01 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:02.163804 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a722bffb-67ed-4f4d-968f-1e8bcd706e82 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:02.164640 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a722bffb-67ed-4f4d-968f-1e8bcd706e82 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:02.171742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a722bffb-67ed-4f4d-968f-1e8bcd706e82 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:02.172532 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a722bffb-67ed-4f4d-968f-1e8bcd706e82 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:02.174560 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a722bffb-67ed-4f4d-968f-1e8bcd706e82 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:02.175357 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a722bffb-67ed-4f4d-968f-1e8bcd706e82 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:02.175853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a722bffb-67ed-4f4d-968f-1e8bcd706e82 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:02.176085 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-609f2358-2ae3-4d89-8a57-58e8d1249264 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:02.179865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a722bffb-67ed-4f4d-968f-1e8bcd706e82 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:02.185720 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-609f2358-2ae3-4d89-8a57-58e8d1249264 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:02.187261 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-609f2358-2ae3-4d89-8a57-58e8d1249264 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:02.188901 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-609f2358-2ae3-4d89-8a57-58e8d1249264 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1407 microversion: 2.20 time: 0.174261 Sep 26 18:10:02.189672 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 353/719] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:10:02 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:10:02.328179 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a722bffb-67ed-4f4d-968f-1e8bcd706e82 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:02.336670 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a722bffb-67ed-4f4d-968f-1e8bcd706e82 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1363 microversion: 2.1 time: 0.177618 Sep 26 18:10:02.337243 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 367/720] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:02 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:10:03.082866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-fa7ff4c8-a891-4c45-85a0-52a164d427ea tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:03.083784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-fa7ff4c8-a891-4c45-85a0-52a164d427ea tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:03.085962 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=4 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:03.086709 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=16 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:03.091686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa7ff4c8-a891-4c45-85a0-52a164d427ea tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:03.098510 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa7ff4c8-a891-4c45-85a0-52a164d427ea tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:03.098510 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa7ff4c8-a891-4c45-85a0-52a164d427ea tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:03.098510 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa7ff4c8-a891-4c45-85a0-52a164d427ea tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:03.098510 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa7ff4c8-a891-4c45-85a0-52a164d427ea tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:03.099159 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa7ff4c8-a891-4c45-85a0-52a164d427ea tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:03.225517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-42c80563-8fe4-4803-86f7-bd8da93eec02 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:03.225517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-42c80563-8fe4-4803-86f7-bd8da93eec02 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:03.240397 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-42c80563-8fe4-4803-86f7-bd8da93eec02 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:03.240904 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-42c80563-8fe4-4803-86f7-bd8da93eec02 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:03.241360 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-42c80563-8fe4-4803-86f7-bd8da93eec02 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:03.242081 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-42c80563-8fe4-4803-86f7-bd8da93eec02 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:03.242546 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-42c80563-8fe4-4803-86f7-bd8da93eec02 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:03.242982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-42c80563-8fe4-4803-86f7-bd8da93eec02 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:03.264051 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-fa7ff4c8-a891-4c45-85a0-52a164d427ea tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:03.274540 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-fa7ff4c8-a891-4c45-85a0-52a164d427ea tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1569 microversion: 2.1 time: 0.196052 Sep 26 18:10:03.275268 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 354/721] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:03 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:03.363009 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-893bf566-8eaf-493e-ba7b-27dffda64b56 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:03.363844 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-893bf566-8eaf-493e-ba7b-27dffda64b56 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:03.369995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-893bf566-8eaf-493e-ba7b-27dffda64b56 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:03.370769 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-893bf566-8eaf-493e-ba7b-27dffda64b56 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:03.371223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-893bf566-8eaf-493e-ba7b-27dffda64b56 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:03.372308 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-893bf566-8eaf-493e-ba7b-27dffda64b56 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:03.372765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-893bf566-8eaf-493e-ba7b-27dffda64b56 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:03.373186 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-893bf566-8eaf-493e-ba7b-27dffda64b56 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:03.381997 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-42c80563-8fe4-4803-86f7-bd8da93eec02 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:03.391263 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-42c80563-8fe4-4803-86f7-bd8da93eec02 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:03.393553 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-42c80563-8fe4-4803-86f7-bd8da93eec02 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:03.394933 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-42c80563-8fe4-4803-86f7-bd8da93eec02 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1407 microversion: 2.20 time: 0.182055 Sep 26 18:10:03.395659 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 368/722] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:10:03 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:10:03.514825 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-893bf566-8eaf-493e-ba7b-27dffda64b56 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:03.523847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-893bf566-8eaf-493e-ba7b-27dffda64b56 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1363 microversion: 2.1 time: 0.166666 Sep 26 18:10:03.524421 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 355/723] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:03 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:10:04.312532 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-75e5246e-41c0-43ad-9237-45a245fad37f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:04.313317 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-75e5246e-41c0-43ad-9237-45a245fad37f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:04.321801 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75e5246e-41c0-43ad-9237-45a245fad37f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:04.322227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75e5246e-41c0-43ad-9237-45a245fad37f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:04.322735 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75e5246e-41c0-43ad-9237-45a245fad37f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:04.323366 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75e5246e-41c0-43ad-9237-45a245fad37f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:04.323867 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75e5246e-41c0-43ad-9237-45a245fad37f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:04.324293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-75e5246e-41c0-43ad-9237-45a245fad37f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:04.427009 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-06c29170-1ead-4251-9b12-aa555f29e35a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:04.428211 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-06c29170-1ead-4251-9b12-aa555f29e35a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:04.439187 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-06c29170-1ead-4251-9b12-aa555f29e35a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:04.440373 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-06c29170-1ead-4251-9b12-aa555f29e35a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:04.440928 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-06c29170-1ead-4251-9b12-aa555f29e35a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:04.441757 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-06c29170-1ead-4251-9b12-aa555f29e35a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:04.442355 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-06c29170-1ead-4251-9b12-aa555f29e35a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:04.443160 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-06c29170-1ead-4251-9b12-aa555f29e35a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:04.485563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=12 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:04.519562 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-75e5246e-41c0-43ad-9237-45a245fad37f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:04.529656 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-75e5246e-41c0-43ad-9237-45a245fad37f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1569 microversion: 2.1 time: 0.222016 Sep 26 18:10:04.531276 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 369/724] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:04 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:04.555080 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8e16ab65-4f68-4f21-b8dd-dcedf331479f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:04.556564 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-8e16ab65-4f68-4f21-b8dd-dcedf331479f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:04.568863 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8e16ab65-4f68-4f21-b8dd-dcedf331479f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:04.569802 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8e16ab65-4f68-4f21-b8dd-dcedf331479f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:04.570627 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8e16ab65-4f68-4f21-b8dd-dcedf331479f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:04.571854 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8e16ab65-4f68-4f21-b8dd-dcedf331479f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:04.572775 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8e16ab65-4f68-4f21-b8dd-dcedf331479f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:04.573386 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8e16ab65-4f68-4f21-b8dd-dcedf331479f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:04.707877 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-06c29170-1ead-4251-9b12-aa555f29e35a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:04.722207 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-06c29170-1ead-4251-9b12-aa555f29e35a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:04.723850 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-06c29170-1ead-4251-9b12-aa555f29e35a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:04.725372 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-06c29170-1ead-4251-9b12-aa555f29e35a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1407 microversion: 2.20 time: 0.306356 Sep 26 18:10:04.726503 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 356/725] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:10:04 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:10:04.779496 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-9fbd0be5-12cc-407c-b0f6-2f64ae003b41 req-dcbf7a02-12c1-43de-8f23-56c36310690d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157c830f-c695-4a1a-a21f-1d0d6c24dd93", "name": "network-vif-plugged", "status": "completed", "tag": "4810d7ad-3670-4d57-835a-ea0d6344ef48"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:10:04.790595 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-9fbd0be5-12cc-407c-b0f6-2f64ae003b41 req-dcbf7a02-12c1-43de-8f23-56c36310690d service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:04.791080 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-9fbd0be5-12cc-407c-b0f6-2f64ae003b41 req-dcbf7a02-12c1-43de-8f23-56c36310690d service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:04.791580 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-9fbd0be5-12cc-407c-b0f6-2f64ae003b41 req-dcbf7a02-12c1-43de-8f23-56c36310690d service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:04.794331 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-8e16ab65-4f68-4f21-b8dd-dcedf331479f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:04.803675 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-9fbd0be5-12cc-407c-b0f6-2f64ae003b41 req-dcbf7a02-12c1-43de-8f23-56c36310690d service nova] Creating event network-vif-plugged:4810d7ad-3670-4d57-835a-ea0d6344ef48 for instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 on hv-cinder-85931 Sep 26 18:10:04.806453 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-8e16ab65-4f68-4f21-b8dd-dcedf331479f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1363 microversion: 2.1 time: 0.260949 Sep 26 18:10:04.807701 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 370/726] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:04 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:10:04.813841 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-9fbd0be5-12cc-407c-b0f6-2f64ae003b41 req-dcbf7a02-12c1-43de-8f23-56c36310690d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040422 Sep 26 18:10:04.815075 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 357/727] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:10:05.561165 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8bcb288f-5022-488b-a573-2f40b78aed4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:05.561902 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-8bcb288f-5022-488b-a573-2f40b78aed4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:05.568943 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8bcb288f-5022-488b-a573-2f40b78aed4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:05.569441 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8bcb288f-5022-488b-a573-2f40b78aed4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:05.569879 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8bcb288f-5022-488b-a573-2f40b78aed4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:05.570598 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8bcb288f-5022-488b-a573-2f40b78aed4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:05.571070 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8bcb288f-5022-488b-a573-2f40b78aed4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:05.571896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8bcb288f-5022-488b-a573-2f40b78aed4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:05.752417 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-8bcb288f-5022-488b-a573-2f40b78aed4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:05.755083 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f9e1d241-5f50-4c5c-84c2-a25cacbf04d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:05.755911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f9e1d241-5f50-4c5c-84c2-a25cacbf04d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:05.768433 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-8bcb288f-5022-488b-a573-2f40b78aed4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1569 microversion: 2.1 time: 0.203761 Sep 26 18:10:05.768433 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 371/728] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:05 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:10:05.768718 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9e1d241-5f50-4c5c-84c2-a25cacbf04d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:05.768718 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9e1d241-5f50-4c5c-84c2-a25cacbf04d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:05.768718 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9e1d241-5f50-4c5c-84c2-a25cacbf04d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:05.768718 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9e1d241-5f50-4c5c-84c2-a25cacbf04d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:05.769394 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9e1d241-5f50-4c5c-84c2-a25cacbf04d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:05.769394 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9e1d241-5f50-4c5c-84c2-a25cacbf04d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:05.833831 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d8ffb622-6448-4e61-acf2-879ac7942ea9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:05.834849 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d8ffb622-6448-4e61-acf2-879ac7942ea9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:05.841853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d8ffb622-6448-4e61-acf2-879ac7942ea9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:05.842364 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d8ffb622-6448-4e61-acf2-879ac7942ea9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:05.842805 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d8ffb622-6448-4e61-acf2-879ac7942ea9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:05.843519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d8ffb622-6448-4e61-acf2-879ac7942ea9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:05.844046 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d8ffb622-6448-4e61-acf2-879ac7942ea9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:05.844473 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d8ffb622-6448-4e61-acf2-879ac7942ea9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:05.966365 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f9e1d241-5f50-4c5c-84c2-a25cacbf04d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:05.982560 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f9e1d241-5f50-4c5c-84c2-a25cacbf04d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:05.985504 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f9e1d241-5f50-4c5c-84c2-a25cacbf04d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:05.988415 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f9e1d241-5f50-4c5c-84c2-a25cacbf04d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1407 microversion: 2.20 time: 0.239707 Sep 26 18:10:05.989429 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 358/729] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:10:05 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:10:06.030620 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d8ffb622-6448-4e61-acf2-879ac7942ea9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:06.039055 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d8ffb622-6448-4e61-acf2-879ac7942ea9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1363 microversion: 2.1 time: 0.211175 Sep 26 18:10:06.039620 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 372/730] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:05 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:10:06.788720 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b1b680ba-6a34-4d2d-b492-1d0feae72e4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:06.789857 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b1b680ba-6a34-4d2d-b492-1d0feae72e4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:06.801049 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1b680ba-6a34-4d2d-b492-1d0feae72e4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:06.802079 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1b680ba-6a34-4d2d-b492-1d0feae72e4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:06.802659 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1b680ba-6a34-4d2d-b492-1d0feae72e4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:06.803906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1b680ba-6a34-4d2d-b492-1d0feae72e4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:06.804694 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1b680ba-6a34-4d2d-b492-1d0feae72e4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:06.805434 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1b680ba-6a34-4d2d-b492-1d0feae72e4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:06.846105 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-13613bd7-23a1-40d0-a00f-41aaa02634b4 req-180a22b6-cf87-494f-a731-fc33a6d4cc08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7369614f-dc83-49a8-b16c-2c2189b1e9db", "name": "network-vif-plugged", "status": "completed", "tag": "555a4990-c7e3-456c-b0c7-7742d6f81240"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:10:06.856089 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-13613bd7-23a1-40d0-a00f-41aaa02634b4 req-180a22b6-cf87-494f-a731-fc33a6d4cc08 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:06.856569 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-13613bd7-23a1-40d0-a00f-41aaa02634b4 req-180a22b6-cf87-494f-a731-fc33a6d4cc08 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:06.856996 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-13613bd7-23a1-40d0-a00f-41aaa02634b4 req-180a22b6-cf87-494f-a731-fc33a6d4cc08 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:06.869425 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-13613bd7-23a1-40d0-a00f-41aaa02634b4 req-180a22b6-cf87-494f-a731-fc33a6d4cc08 service nova] Creating event network-vif-plugged:555a4990-c7e3-456c-b0c7-7742d6f81240 for instance 7369614f-dc83-49a8-b16c-2c2189b1e9db on hv-cinder-85931 Sep 26 18:10:06.875038 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-13613bd7-23a1-40d0-a00f-41aaa02634b4 req-180a22b6-cf87-494f-a731-fc33a6d4cc08 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033393 Sep 26 18:10:06.875634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 373/731] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:10:07.017603 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b1b680ba-6a34-4d2d-b492-1d0feae72e4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:07.018241 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-28bfb123-03ae-4dd0-aac8-ed456e914ca1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:07.019460 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-28bfb123-03ae-4dd0-aac8-ed456e914ca1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:07.027960 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b1b680ba-6a34-4d2d-b492-1d0feae72e4b tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1569 microversion: 2.1 time: 0.245736 Sep 26 18:10:07.028872 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 359/732] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:06 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:07.030913 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28bfb123-03ae-4dd0-aac8-ed456e914ca1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:07.032140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28bfb123-03ae-4dd0-aac8-ed456e914ca1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:07.033036 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28bfb123-03ae-4dd0-aac8-ed456e914ca1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:07.034351 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28bfb123-03ae-4dd0-aac8-ed456e914ca1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:07.035434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28bfb123-03ae-4dd0-aac8-ed456e914ca1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:07.036516 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28bfb123-03ae-4dd0-aac8-ed456e914ca1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:07.074442 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-07c0c3e5-cc20-433d-b7b2-58a16441f0c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:07.075061 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-07c0c3e5-cc20-433d-b7b2-58a16441f0c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:07.085712 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-07c0c3e5-cc20-433d-b7b2-58a16441f0c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:07.086707 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-07c0c3e5-cc20-433d-b7b2-58a16441f0c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:07.087475 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-07c0c3e5-cc20-433d-b7b2-58a16441f0c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:07.088825 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-07c0c3e5-cc20-433d-b7b2-58a16441f0c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:07.089533 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-07c0c3e5-cc20-433d-b7b2-58a16441f0c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:07.090255 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-07c0c3e5-cc20-433d-b7b2-58a16441f0c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:07.317828 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-28bfb123-03ae-4dd0-aac8-ed456e914ca1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:07.327411 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-28bfb123-03ae-4dd0-aac8-ed456e914ca1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:07.329123 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-28bfb123-03ae-4dd0-aac8-ed456e914ca1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:07.331331 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-28bfb123-03ae-4dd0-aac8-ed456e914ca1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1598 microversion: 2.20 time: 0.320098 Sep 26 18:10:07.331932 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 374/733] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:10:07 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1598 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:10:07.332438 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-07c0c3e5-cc20-433d-b7b2-58a16441f0c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:07.342539 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-07c0c3e5-cc20-433d-b7b2-58a16441f0c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1363 microversion: 2.1 time: 0.274534 Sep 26 18:10:07.347114 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 360/734] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:07 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:10:07.372632 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-cfc5e9b5-d5c8-4e61-a24d-0b6b14f64a72 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:07.373510 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-cfc5e9b5-d5c8-4e61-a24d-0b6b14f64a72 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:07.383367 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cfc5e9b5-d5c8-4e61-a24d-0b6b14f64a72 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:07.387687 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cfc5e9b5-d5c8-4e61-a24d-0b6b14f64a72 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:07.387687 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cfc5e9b5-d5c8-4e61-a24d-0b6b14f64a72 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:07.387687 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cfc5e9b5-d5c8-4e61-a24d-0b6b14f64a72 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:07.387687 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cfc5e9b5-d5c8-4e61-a24d-0b6b14f64a72 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:07.388256 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cfc5e9b5-d5c8-4e61-a24d-0b6b14f64a72 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:07.390628 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:07.471949 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-cfc5e9b5-d5c8-4e61-a24d-0b6b14f64a72 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102927 Sep 26 18:10:07.473648 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 375/735] 10.222.0.67 () {60 vars in 1316 bytes} [Mon Sep 26 18:10:07 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 18:10:08.053387 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-997f4fe4-4c7b-4f4f-8946-1dd612b8b03f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:08.054339 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-997f4fe4-4c7b-4f4f-8946-1dd612b8b03f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:08.060398 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-997f4fe4-4c7b-4f4f-8946-1dd612b8b03f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:08.060890 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-997f4fe4-4c7b-4f4f-8946-1dd612b8b03f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:08.061507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-997f4fe4-4c7b-4f4f-8946-1dd612b8b03f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:08.062411 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-997f4fe4-4c7b-4f4f-8946-1dd612b8b03f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:08.062872 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-997f4fe4-4c7b-4f4f-8946-1dd612b8b03f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:08.063297 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-997f4fe4-4c7b-4f4f-8946-1dd612b8b03f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:08.219147 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-997f4fe4-4c7b-4f4f-8946-1dd612b8b03f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:08.227373 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-997f4fe4-4c7b-4f4f-8946-1dd612b8b03f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1569 microversion: 2.1 time: 0.179137 Sep 26 18:10:08.228191 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 361/736] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:08 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:08.369377 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e43d0cc1-b944-4ba3-8cb3-9f675eabf590 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:08.370079 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e43d0cc1-b944-4ba3-8cb3-9f675eabf590 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:08.377626 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e43d0cc1-b944-4ba3-8cb3-9f675eabf590 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:08.378144 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e43d0cc1-b944-4ba3-8cb3-9f675eabf590 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:08.378598 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e43d0cc1-b944-4ba3-8cb3-9f675eabf590 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:08.379276 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e43d0cc1-b944-4ba3-8cb3-9f675eabf590 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:08.379760 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e43d0cc1-b944-4ba3-8cb3-9f675eabf590 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:08.380183 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e43d0cc1-b944-4ba3-8cb3-9f675eabf590 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:08.529713 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e43d0cc1-b944-4ba3-8cb3-9f675eabf590 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:08.537952 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e43d0cc1-b944-4ba3-8cb3-9f675eabf590 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1363 microversion: 2.1 time: 0.173896 Sep 26 18:10:08.538527 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 376/737] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:08 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:08.839746 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-1c4aeabd-7096-492e-811d-84adc812410d req-adda13bd-36a0-46d7-96c7-cef8d0b907b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157c830f-c695-4a1a-a21f-1d0d6c24dd93", "tag": "4810d7ad-3670-4d57-835a-ea0d6344ef48"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:10:08.850876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-1c4aeabd-7096-492e-811d-84adc812410d req-adda13bd-36a0-46d7-96c7-cef8d0b907b0 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:08.851686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-1c4aeabd-7096-492e-811d-84adc812410d req-adda13bd-36a0-46d7-96c7-cef8d0b907b0 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:08.852223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-1c4aeabd-7096-492e-811d-84adc812410d req-adda13bd-36a0-46d7-96c7-cef8d0b907b0 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:08.869908 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-1c4aeabd-7096-492e-811d-84adc812410d req-adda13bd-36a0-46d7-96c7-cef8d0b907b0 service nova] Creating event network-changed:4810d7ad-3670-4d57-835a-ea0d6344ef48 for instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 on hv-cinder-85931 Sep 26 18:10:08.877115 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-1c4aeabd-7096-492e-811d-84adc812410d req-adda13bd-36a0-46d7-96c7-cef8d0b907b0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040244 Sep 26 18:10:08.877733 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 362/738] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:10:09.259948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-88d66645-111c-4f4e-afe7-1856fd59d9cd tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:09.260647 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-88d66645-111c-4f4e-afe7-1856fd59d9cd tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:09.268442 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-88d66645-111c-4f4e-afe7-1856fd59d9cd tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:09.268950 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-88d66645-111c-4f4e-afe7-1856fd59d9cd tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:09.269398 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-88d66645-111c-4f4e-afe7-1856fd59d9cd tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:09.270129 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-88d66645-111c-4f4e-afe7-1856fd59d9cd tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:09.270834 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-88d66645-111c-4f4e-afe7-1856fd59d9cd tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:09.271297 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-88d66645-111c-4f4e-afe7-1856fd59d9cd tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:09.465653 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-88d66645-111c-4f4e-afe7-1856fd59d9cd tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:09.474978 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-88d66645-111c-4f4e-afe7-1856fd59d9cd tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1569 microversion: 2.1 time: 0.219226 Sep 26 18:10:09.475576 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 377/739] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:09 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:09.565505 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4869c2da-b45a-4b51-92dd-5d9ce4db7479 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:09.571546 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4869c2da-b45a-4b51-92dd-5d9ce4db7479 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:09.575876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4869c2da-b45a-4b51-92dd-5d9ce4db7479 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:09.576748 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4869c2da-b45a-4b51-92dd-5d9ce4db7479 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:09.577525 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4869c2da-b45a-4b51-92dd-5d9ce4db7479 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:09.578739 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4869c2da-b45a-4b51-92dd-5d9ce4db7479 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:09.579593 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4869c2da-b45a-4b51-92dd-5d9ce4db7479 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:09.581418 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4869c2da-b45a-4b51-92dd-5d9ce4db7479 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:09.846450 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-4869c2da-b45a-4b51-92dd-5d9ce4db7479 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:09.859735 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4869c2da-b45a-4b51-92dd-5d9ce4db7479 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1550 microversion: 2.1 time: 0.298888 Sep 26 18:10:09.860535 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 363/740] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:09 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1550 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:09.886633 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-6d70c081-1227-4f17-bd2b-beaaceec713f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:09.887141 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-6d70c081-1227-4f17-bd2b-beaaceec713f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:09.895051 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6d70c081-1227-4f17-bd2b-beaaceec713f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:09.897937 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6d70c081-1227-4f17-bd2b-beaaceec713f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:09.897937 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6d70c081-1227-4f17-bd2b-beaaceec713f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:09.897937 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6d70c081-1227-4f17-bd2b-beaaceec713f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:09.897937 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6d70c081-1227-4f17-bd2b-beaaceec713f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:09.898379 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6d70c081-1227-4f17-bd2b-beaaceec713f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:10.038211 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-6d70c081-1227-4f17-bd2b-beaaceec713f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.157309 Sep 26 18:10:10.038818 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 378/741] 10.222.0.67 () {58 vars in 1275 bytes} [Mon Sep 26 18:10:09 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:10:10.520017 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8320bc5e-ce96-419e-a900-733d4566cf21 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:10.521015 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-8320bc5e-ce96-419e-a900-733d4566cf21 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:10.531727 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8320bc5e-ce96-419e-a900-733d4566cf21 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:10.532708 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8320bc5e-ce96-419e-a900-733d4566cf21 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:10.533821 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8320bc5e-ce96-419e-a900-733d4566cf21 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:10.535432 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8320bc5e-ce96-419e-a900-733d4566cf21 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:10.536379 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8320bc5e-ce96-419e-a900-733d4566cf21 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:10.537269 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8320bc5e-ce96-419e-a900-733d4566cf21 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:10.873833 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8320bc5e-ce96-419e-a900-733d4566cf21 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:10.886880 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8320bc5e-ce96-419e-a900-733d4566cf21 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1569 microversion: 2.1 time: 0.374390 Sep 26 18:10:10.887816 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 364/742] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:10 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1569 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:11.440700 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-86affbad-c180-466d-b332-21096aebc976 req-d537d0e9-6c2b-4ce4-9840-4c9678f048c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7369614f-dc83-49a8-b16c-2c2189b1e9db", "tag": "555a4990-c7e3-456c-b0c7-7742d6f81240"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:10:11.461372 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-86affbad-c180-466d-b332-21096aebc976 req-d537d0e9-6c2b-4ce4-9840-4c9678f048c3 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:11.462245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-86affbad-c180-466d-b332-21096aebc976 req-d537d0e9-6c2b-4ce4-9840-4c9678f048c3 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:11.463026 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-86affbad-c180-466d-b332-21096aebc976 req-d537d0e9-6c2b-4ce4-9840-4c9678f048c3 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:11.484035 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-86affbad-c180-466d-b332-21096aebc976 req-d537d0e9-6c2b-4ce4-9840-4c9678f048c3 service nova] Creating event network-changed:555a4990-c7e3-456c-b0c7-7742d6f81240 for instance 7369614f-dc83-49a8-b16c-2c2189b1e9db on hv-cinder-85931 Sep 26 18:10:11.492488 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-86affbad-c180-466d-b332-21096aebc976 req-d537d0e9-6c2b-4ce4-9840-4c9678f048c3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060561 Sep 26 18:10:11.493637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 379/743] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:10:11.912692 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-65d0c76c-a060-4484-8fa4-8442cb90da27 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:11.913381 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-65d0c76c-a060-4484-8fa4-8442cb90da27 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:11.920607 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-65d0c76c-a060-4484-8fa4-8442cb90da27 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:11.921090 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-65d0c76c-a060-4484-8fa4-8442cb90da27 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:11.921516 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-65d0c76c-a060-4484-8fa4-8442cb90da27 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:11.922209 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-65d0c76c-a060-4484-8fa4-8442cb90da27 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:11.922658 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-65d0c76c-a060-4484-8fa4-8442cb90da27 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:11.923427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-65d0c76c-a060-4484-8fa4-8442cb90da27 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:12.095193 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-65d0c76c-a060-4484-8fa4-8442cb90da27 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:12.106992 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-65d0c76c-a060-4484-8fa4-8442cb90da27 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1569 microversion: 2.1 time: 0.198658 Sep 26 18:10:12.107958 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 365/744] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:11 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:13.144264 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e0f74de9-af3e-4500-823c-52f9b569703d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:13.145115 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e0f74de9-af3e-4500-823c-52f9b569703d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:13.153461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0f74de9-af3e-4500-823c-52f9b569703d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:13.154205 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0f74de9-af3e-4500-823c-52f9b569703d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:13.154640 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0f74de9-af3e-4500-823c-52f9b569703d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:13.155335 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0f74de9-af3e-4500-823c-52f9b569703d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:13.155822 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0f74de9-af3e-4500-823c-52f9b569703d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:13.156247 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0f74de9-af3e-4500-823c-52f9b569703d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:13.398461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e0f74de9-af3e-4500-823c-52f9b569703d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:13.408171 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e0f74de9-af3e-4500-823c-52f9b569703d tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1569 microversion: 2.1 time: 0.268951 Sep 26 18:10:13.409519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 380/745] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:13 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1569 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:14.434356 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6c3ac132-5c9d-4359-b728-dd6078760009 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:14.435323 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-6c3ac132-5c9d-4359-b728-dd6078760009 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:14.443262 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6c3ac132-5c9d-4359-b728-dd6078760009 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:14.444085 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6c3ac132-5c9d-4359-b728-dd6078760009 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:14.446810 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6c3ac132-5c9d-4359-b728-dd6078760009 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:14.446810 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6c3ac132-5c9d-4359-b728-dd6078760009 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:14.446810 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6c3ac132-5c9d-4359-b728-dd6078760009 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:14.446810 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6c3ac132-5c9d-4359-b728-dd6078760009 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:14.632664 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6c3ac132-5c9d-4359-b728-dd6078760009 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:14.648287 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-6c3ac132-5c9d-4359-b728-dd6078760009 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1570 microversion: 2.1 time: 0.217931 Sep 26 18:10:14.649498 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 366/746] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:14 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1570 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:14.678598 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-08d15f93-c32f-49bb-8e38-07415e6c2a9e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:10:14.679703 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-08d15f93-c32f-49bb-8e38-07415e6c2a9e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:14.683993 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:14.693062 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-08d15f93-c32f-49bb-8e38-07415e6c2a9e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:14.716083 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-08d15f93-c32f-49bb-8e38-07415e6c2a9e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:14.716083 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-08d15f93-c32f-49bb-8e38-07415e6c2a9e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:14.716083 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-08d15f93-c32f-49bb-8e38-07415e6c2a9e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:14.716083 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-08d15f93-c32f-49bb-8e38-07415e6c2a9e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:14.716521 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-08d15f93-c32f-49bb-8e38-07415e6c2a9e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:14.818521 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-08d15f93-c32f-49bb-8e38-07415e6c2a9e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121029) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 18:10:15.221906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-08d15f93-c32f-49bb-8e38-07415e6c2a9e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "POST /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8/action" status: 202 len: 0 microversion: 2.1 time: 0.550762 Sep 26 18:10:15.223307 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 381/747] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Sep 26 18:10:14 2022] POST /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:10:15.238155 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d698bf35-a228-4d8b-83b7-c23464000ab8 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:15.239529 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d698bf35-a228-4d8b-83b7-c23464000ab8 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:15.250963 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d698bf35-a228-4d8b-83b7-c23464000ab8 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:15.251930 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d698bf35-a228-4d8b-83b7-c23464000ab8 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:15.252733 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d698bf35-a228-4d8b-83b7-c23464000ab8 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:15.253889 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d698bf35-a228-4d8b-83b7-c23464000ab8 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:15.254383 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d698bf35-a228-4d8b-83b7-c23464000ab8 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:15.255076 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d698bf35-a228-4d8b-83b7-c23464000ab8 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:15.488174 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d698bf35-a228-4d8b-83b7-c23464000ab8 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:15.504326 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d698bf35-a228-4d8b-83b7-c23464000ab8 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1578 microversion: 2.1 time: 0.273036 Sep 26 18:10:15.505342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 367/748] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:15 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1578 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:16.547227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-85a3fc94-47a6-4a45-854a-c1cf53824987 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:16.551493 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-85a3fc94-47a6-4a45-854a-c1cf53824987 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:16.570947 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-097cc20a-b87c-4c3c-83e6-41b9a2e86124 req-29f725fc-ddca-4a3b-9b7f-9e4607729710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19e1622-6521-459d-9db1-80abd4bcf0f8", "name": "network-vif-unplugged", "status": "completed", "tag": "df9e6e2c-d105-4f6a-aaf7-3619c1f5c26c"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:10:16.578478 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85a3fc94-47a6-4a45-854a-c1cf53824987 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:16.578981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85a3fc94-47a6-4a45-854a-c1cf53824987 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:16.581289 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85a3fc94-47a6-4a45-854a-c1cf53824987 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:16.582375 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85a3fc94-47a6-4a45-854a-c1cf53824987 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:16.582959 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85a3fc94-47a6-4a45-854a-c1cf53824987 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:16.583446 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-85a3fc94-47a6-4a45-854a-c1cf53824987 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:16.593794 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-097cc20a-b87c-4c3c-83e6-41b9a2e86124 req-29f725fc-ddca-4a3b-9b7f-9e4607729710 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:16.594854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-097cc20a-b87c-4c3c-83e6-41b9a2e86124 req-29f725fc-ddca-4a3b-9b7f-9e4607729710 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:16.596706 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-097cc20a-b87c-4c3c-83e6-41b9a2e86124 req-29f725fc-ddca-4a3b-9b7f-9e4607729710 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:16.621638 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.compute.server_external_events [req-097cc20a-b87c-4c3c-83e6-41b9a2e86124 req-29f725fc-ddca-4a3b-9b7f-9e4607729710 service nova] Unable to find a host for instance b19e1622-6521-459d-9db1-80abd4bcf0f8. Dropping event network-vif-unplugged {{(pid=121028) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 26 18:10:16.623458 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-097cc20a-b87c-4c3c-83e6-41b9a2e86124 req-29f725fc-ddca-4a3b-9b7f-9e4607729710 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.065033 Sep 26 18:10:16.626287 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 368/749] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 69 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 26 18:10:16.813515 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-85a3fc94-47a6-4a45-854a-c1cf53824987 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:16.828204 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-85a3fc94-47a6-4a45-854a-c1cf53824987 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1520 microversion: 2.1 time: 0.287971 Sep 26 18:10:16.829132 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 382/750] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:16 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:17.870333 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-356d670e-8150-4743-953c-9595dc707bfa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:17.872208 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-356d670e-8150-4743-953c-9595dc707bfa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:17.885784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-356d670e-8150-4743-953c-9595dc707bfa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:17.886706 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-356d670e-8150-4743-953c-9595dc707bfa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:17.887607 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-356d670e-8150-4743-953c-9595dc707bfa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:17.888606 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-356d670e-8150-4743-953c-9595dc707bfa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:17.889307 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-356d670e-8150-4743-953c-9595dc707bfa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:17.890129 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-356d670e-8150-4743-953c-9595dc707bfa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:18.105893 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-356d670e-8150-4743-953c-9595dc707bfa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:18.121141 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-356d670e-8150-4743-953c-9595dc707bfa tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1520 microversion: 2.1 time: 0.259626 Sep 26 18:10:18.122153 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 369/751] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:17 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:19.162845 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e2cdac83-10da-4647-994a-c852664b1bd5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:19.164507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e2cdac83-10da-4647-994a-c852664b1bd5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:19.175334 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e2cdac83-10da-4647-994a-c852664b1bd5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:19.175917 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e2cdac83-10da-4647-994a-c852664b1bd5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:19.176285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e2cdac83-10da-4647-994a-c852664b1bd5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:19.176997 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e2cdac83-10da-4647-994a-c852664b1bd5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:19.177482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e2cdac83-10da-4647-994a-c852664b1bd5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:19.177911 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e2cdac83-10da-4647-994a-c852664b1bd5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:19.466952 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e2cdac83-10da-4647-994a-c852664b1bd5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:19.476871 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e2cdac83-10da-4647-994a-c852664b1bd5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1576 microversion: 2.1 time: 0.322315 Sep 26 18:10:19.477559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 383/752] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:19 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1576 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:20.580050 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-91adc9e7-5c23-47e9-a48f-efb313d0c74f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:20.580863 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-91adc9e7-5c23-47e9-a48f-efb313d0c74f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:20.587393 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-91adc9e7-5c23-47e9-a48f-efb313d0c74f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:20.587934 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-91adc9e7-5c23-47e9-a48f-efb313d0c74f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:20.588380 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-91adc9e7-5c23-47e9-a48f-efb313d0c74f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:20.589084 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-91adc9e7-5c23-47e9-a48f-efb313d0c74f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:20.589536 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-91adc9e7-5c23-47e9-a48f-efb313d0c74f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:20.589987 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-91adc9e7-5c23-47e9-a48f-efb313d0c74f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:20.592892 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=100 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:20.741811 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-91adc9e7-5c23-47e9-a48f-efb313d0c74f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:20.749928 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-91adc9e7-5c23-47e9-a48f-efb313d0c74f tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1576 microversion: 2.1 time: 0.173914 Sep 26 18:10:20.750496 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 370/753] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:20 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:21.783187 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a8fc400d-3b16-4267-806e-4b95cbe154f3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:21.783890 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a8fc400d-3b16-4267-806e-4b95cbe154f3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:21.793009 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8fc400d-3b16-4267-806e-4b95cbe154f3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:21.793492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8fc400d-3b16-4267-806e-4b95cbe154f3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:21.793920 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8fc400d-3b16-4267-806e-4b95cbe154f3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:21.794614 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8fc400d-3b16-4267-806e-4b95cbe154f3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:21.795073 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8fc400d-3b16-4267-806e-4b95cbe154f3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:21.795490 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8fc400d-3b16-4267-806e-4b95cbe154f3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:21.943437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a8fc400d-3b16-4267-806e-4b95cbe154f3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:21.952045 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a8fc400d-3b16-4267-806e-4b95cbe154f3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1576 microversion: 2.1 time: 0.172661 Sep 26 18:10:21.952628 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 384/754] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:21 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:22.976925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c70b3775-c479-4f08-8557-cb1a56208209 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:22.977623 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c70b3775-c479-4f08-8557-cb1a56208209 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:22.984429 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c70b3775-c479-4f08-8557-cb1a56208209 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:22.991625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c70b3775-c479-4f08-8557-cb1a56208209 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:22.991625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c70b3775-c479-4f08-8557-cb1a56208209 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:22.991625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c70b3775-c479-4f08-8557-cb1a56208209 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:22.991625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c70b3775-c479-4f08-8557-cb1a56208209 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:22.992179 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c70b3775-c479-4f08-8557-cb1a56208209 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:23.136756 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c70b3775-c479-4f08-8557-cb1a56208209 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:23.146817 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c70b3775-c479-4f08-8557-cb1a56208209 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1576 microversion: 2.1 time: 0.173867 Sep 26 18:10:23.147416 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 371/755] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:22 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:10:24.171265 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9b656d84-49ad-4ce2-b25a-cebbab5a4962 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:24.171918 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9b656d84-49ad-4ce2-b25a-cebbab5a4962 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:24.179412 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9b656d84-49ad-4ce2-b25a-cebbab5a4962 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:24.179951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9b656d84-49ad-4ce2-b25a-cebbab5a4962 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:24.180391 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9b656d84-49ad-4ce2-b25a-cebbab5a4962 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:24.181153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9b656d84-49ad-4ce2-b25a-cebbab5a4962 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:24.181614 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9b656d84-49ad-4ce2-b25a-cebbab5a4962 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:24.182044 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9b656d84-49ad-4ce2-b25a-cebbab5a4962 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:24.331430 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9b656d84-49ad-4ce2-b25a-cebbab5a4962 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:24.340082 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9b656d84-49ad-4ce2-b25a-cebbab5a4962 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1576 microversion: 2.1 time: 0.172858 Sep 26 18:10:24.340656 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 385/756] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:24 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:25.363975 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f961a67e-a7a5-4a3b-9650-7423a5c979a3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:25.364661 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f961a67e-a7a5-4a3b-9650-7423a5c979a3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:25.371775 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f961a67e-a7a5-4a3b-9650-7423a5c979a3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:25.372315 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f961a67e-a7a5-4a3b-9650-7423a5c979a3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:25.372749 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f961a67e-a7a5-4a3b-9650-7423a5c979a3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:25.373469 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f961a67e-a7a5-4a3b-9650-7423a5c979a3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:25.373918 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f961a67e-a7a5-4a3b-9650-7423a5c979a3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:25.374332 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f961a67e-a7a5-4a3b-9650-7423a5c979a3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:25.521639 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f961a67e-a7a5-4a3b-9650-7423a5c979a3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:25.529543 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f961a67e-a7a5-4a3b-9650-7423a5c979a3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1576 microversion: 2.1 time: 0.170142 Sep 26 18:10:25.530119 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 372/757] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:25 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:26.554950 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e0cee6b8-3964-48f8-86eb-a2bba0af274e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:26.555553 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e0cee6b8-3964-48f8-86eb-a2bba0af274e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:26.562130 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0cee6b8-3964-48f8-86eb-a2bba0af274e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:26.562615 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0cee6b8-3964-48f8-86eb-a2bba0af274e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:26.563059 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0cee6b8-3964-48f8-86eb-a2bba0af274e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:26.564392 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0cee6b8-3964-48f8-86eb-a2bba0af274e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:26.564973 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0cee6b8-3964-48f8-86eb-a2bba0af274e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:26.565403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e0cee6b8-3964-48f8-86eb-a2bba0af274e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:26.701569 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e0cee6b8-3964-48f8-86eb-a2bba0af274e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:26.709827 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e0cee6b8-3964-48f8-86eb-a2bba0af274e tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1576 microversion: 2.1 time: 0.158907 Sep 26 18:10:26.710413 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 386/758] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:26 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:27.739635 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-86450007-be04-4ea7-b84c-390755dcab80 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:27.740689 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-86450007-be04-4ea7-b84c-390755dcab80 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:27.746751 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-86450007-be04-4ea7-b84c-390755dcab80 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:27.752285 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-86450007-be04-4ea7-b84c-390755dcab80 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:27.752285 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-86450007-be04-4ea7-b84c-390755dcab80 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:27.752285 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-86450007-be04-4ea7-b84c-390755dcab80 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:27.752285 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-86450007-be04-4ea7-b84c-390755dcab80 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:27.752874 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-86450007-be04-4ea7-b84c-390755dcab80 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:27.900823 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-86450007-be04-4ea7-b84c-390755dcab80 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:27.909411 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-86450007-be04-4ea7-b84c-390755dcab80 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1576 microversion: 2.1 time: 0.176954 Sep 26 18:10:27.909903 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 373/759] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:27 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:28.934538 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f8f69a7b-60b6-4dfa-b620-955bc202fe56 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:28.935156 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f8f69a7b-60b6-4dfa-b620-955bc202fe56 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:28.942984 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8f69a7b-60b6-4dfa-b620-955bc202fe56 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:28.943480 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8f69a7b-60b6-4dfa-b620-955bc202fe56 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:28.945248 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8f69a7b-60b6-4dfa-b620-955bc202fe56 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:28.950290 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8f69a7b-60b6-4dfa-b620-955bc202fe56 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:28.950793 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8f69a7b-60b6-4dfa-b620-955bc202fe56 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:28.951240 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8f69a7b-60b6-4dfa-b620-955bc202fe56 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:29.088317 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f8f69a7b-60b6-4dfa-b620-955bc202fe56 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:29.096700 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f8f69a7b-60b6-4dfa-b620-955bc202fe56 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1576 microversion: 2.1 time: 0.168081 Sep 26 18:10:29.097281 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 387/760] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:28 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:10:29.418173 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-0828e985-9aaf-446f-b2da-7d05c1185f80 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:29.418894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-0828e985-9aaf-446f-b2da-7d05c1185f80 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:29.425094 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0828e985-9aaf-446f-b2da-7d05c1185f80 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:29.425710 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0828e985-9aaf-446f-b2da-7d05c1185f80 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:29.426178 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0828e985-9aaf-446f-b2da-7d05c1185f80 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:29.426723 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0828e985-9aaf-446f-b2da-7d05c1185f80 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:29.428660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0828e985-9aaf-446f-b2da-7d05c1185f80 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:29.428660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0828e985-9aaf-446f-b2da-7d05c1185f80 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:29.457197 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-0828e985-9aaf-446f-b2da-7d05c1185f80 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e/ips" status: 200 len: 150 microversion: 2.1 time: 0.043369 Sep 26 18:10:29.457787 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 374/761] 10.222.0.67 () {58 vars in 1248 bytes} [Mon Sep 26 18:10:29 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:10:30.120489 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f66a533d-0d7f-453f-88f8-84c1b5db9b73 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:30.122372 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f66a533d-0d7f-453f-88f8-84c1b5db9b73 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:30.134309 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f66a533d-0d7f-453f-88f8-84c1b5db9b73 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:30.134309 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f66a533d-0d7f-453f-88f8-84c1b5db9b73 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:30.134309 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f66a533d-0d7f-453f-88f8-84c1b5db9b73 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:30.134309 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f66a533d-0d7f-453f-88f8-84c1b5db9b73 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:30.134684 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f66a533d-0d7f-453f-88f8-84c1b5db9b73 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:30.134684 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f66a533d-0d7f-453f-88f8-84c1b5db9b73 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:30.300632 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f66a533d-0d7f-453f-88f8-84c1b5db9b73 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:30.308839 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f66a533d-0d7f-453f-88f8-84c1b5db9b73 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1576 microversion: 2.1 time: 0.192330 Sep 26 18:10:30.309426 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 388/762] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:30 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:30.665643 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-10fa20a2-4a8c-4eee-b8b3-d8f931dd4f5a req-afccb03e-9fef-46fa-988a-ba93e4974ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19e1622-6521-459d-9db1-80abd4bcf0f8", "name": "network-vif-plugged", "status": "completed", "tag": "df9e6e2c-d105-4f6a-aaf7-3619c1f5c26c"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:10:30.676052 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=51 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:30.683450 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-10fa20a2-4a8c-4eee-b8b3-d8f931dd4f5a req-afccb03e-9fef-46fa-988a-ba93e4974ff7 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:30.683891 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-10fa20a2-4a8c-4eee-b8b3-d8f931dd4f5a req-afccb03e-9fef-46fa-988a-ba93e4974ff7 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:30.684326 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-10fa20a2-4a8c-4eee-b8b3-d8f931dd4f5a req-afccb03e-9fef-46fa-988a-ba93e4974ff7 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:30.703149 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-10fa20a2-4a8c-4eee-b8b3-d8f931dd4f5a req-afccb03e-9fef-46fa-988a-ba93e4974ff7 service nova] Creating event network-vif-plugged:df9e6e2c-d105-4f6a-aaf7-3619c1f5c26c for instance b19e1622-6521-459d-9db1-80abd4bcf0f8 on hv-cinder-85931 Sep 26 18:10:30.708926 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-10fa20a2-4a8c-4eee-b8b3-d8f931dd4f5a req-afccb03e-9fef-46fa-988a-ba93e4974ff7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048669 Sep 26 18:10:30.709621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 375/763] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:10:31.253148 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-dbc2614f-ea05-4b66-a4ed-4e84dee2ee2e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "403c0299-35e0-4b82-acfc-d1653a5565eb"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:10:31.255676 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-dbc2614f-ea05-4b66-a4ed-4e84dee2ee2e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:31.262858 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dbc2614f-ea05-4b66-a4ed-4e84dee2ee2e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:31.263354 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dbc2614f-ea05-4b66-a4ed-4e84dee2ee2e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:31.263843 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dbc2614f-ea05-4b66-a4ed-4e84dee2ee2e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:31.264567 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dbc2614f-ea05-4b66-a4ed-4e84dee2ee2e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:31.265032 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dbc2614f-ea05-4b66-a4ed-4e84dee2ee2e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:31.265459 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dbc2614f-ea05-4b66-a4ed-4e84dee2ee2e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:31.335704 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-cc471a3e-363d-44eb-a4fb-24c68cd8dd0a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:31.336405 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-cc471a3e-363d-44eb-a4fb-24c68cd8dd0a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:31.343174 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cc471a3e-363d-44eb-a4fb-24c68cd8dd0a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:31.343683 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cc471a3e-363d-44eb-a4fb-24c68cd8dd0a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:31.344108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cc471a3e-363d-44eb-a4fb-24c68cd8dd0a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:31.346018 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cc471a3e-363d-44eb-a4fb-24c68cd8dd0a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:31.346578 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cc471a3e-363d-44eb-a4fb-24c68cd8dd0a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:31.347254 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cc471a3e-363d-44eb-a4fb-24c68cd8dd0a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:31.508719 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-cc471a3e-363d-44eb-a4fb-24c68cd8dd0a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:31.521459 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-cc471a3e-363d-44eb-a4fb-24c68cd8dd0a tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1576 microversion: 2.1 time: 0.189848 Sep 26 18:10:31.522068 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 376/764] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:31 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:32.518038 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-dbc2614f-ea05-4b66-a4ed-4e84dee2ee2e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "POST /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.269032 Sep 26 18:10:32.518637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 389/765] 10.222.0.67 () {60 vars in 1323 bytes} [Mon Sep 26 18:10:31 2022] POST /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e/os-volume_attachments => generated 194 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:10:32.545949 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c2fdaf8a-17ef-446b-8d36-95ba61976507 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:32.546905 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c2fdaf8a-17ef-446b-8d36-95ba61976507 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:32.553860 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c2fdaf8a-17ef-446b-8d36-95ba61976507 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:32.554353 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c2fdaf8a-17ef-446b-8d36-95ba61976507 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:32.554791 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c2fdaf8a-17ef-446b-8d36-95ba61976507 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:32.555495 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c2fdaf8a-17ef-446b-8d36-95ba61976507 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:32.556033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c2fdaf8a-17ef-446b-8d36-95ba61976507 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:32.556402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c2fdaf8a-17ef-446b-8d36-95ba61976507 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:32.696929 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c2fdaf8a-17ef-446b-8d36-95ba61976507 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:32.705608 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c2fdaf8a-17ef-446b-8d36-95ba61976507 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1576 microversion: 2.1 time: 0.163336 Sep 26 18:10:32.706188 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 377/766] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:32 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:33.729402 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-95c68b64-93ea-4b52-ae4f-1b2159840bdb tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:33.730088 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-95c68b64-93ea-4b52-ae4f-1b2159840bdb tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:33.737295 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95c68b64-93ea-4b52-ae4f-1b2159840bdb tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:33.737854 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95c68b64-93ea-4b52-ae4f-1b2159840bdb tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:33.738485 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95c68b64-93ea-4b52-ae4f-1b2159840bdb tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:33.739059 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95c68b64-93ea-4b52-ae4f-1b2159840bdb tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:33.739577 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95c68b64-93ea-4b52-ae4f-1b2159840bdb tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:33.740082 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95c68b64-93ea-4b52-ae4f-1b2159840bdb tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:33.886535 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-95c68b64-93ea-4b52-ae4f-1b2159840bdb tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:33.890248 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:33.895581 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-95c68b64-93ea-4b52-ae4f-1b2159840bdb tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1563 microversion: 2.1 time: 0.171020 Sep 26 18:10:33.896183 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 390/767] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:33 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:41.280325 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-48d72370-cff2-4522-bab8-6ec848166613 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:41.282706 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-48d72370-cff2-4522-bab8-6ec848166613 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:41.288466 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-48d72370-cff2-4522-bab8-6ec848166613 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:41.289033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-48d72370-cff2-4522-bab8-6ec848166613 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:41.289503 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-48d72370-cff2-4522-bab8-6ec848166613 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:41.290943 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-48d72370-cff2-4522-bab8-6ec848166613 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:41.291668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-48d72370-cff2-4522-bab8-6ec848166613 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:41.292209 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-48d72370-cff2-4522-bab8-6ec848166613 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:41.382710 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-48d72370-cff2-4522-bab8-6ec848166613 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lazy-loading 'services' on Instance uuid 7a049820-82bd-4c41-8047-5f4fa2d9966e {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:10:41.650105 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-48d72370-cff2-4522-bab8-6ec848166613 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e/os-volume_attachments/403c0299-35e0-4b82-acfc-d1653a5565eb" status: 202 len: 0 microversion: 2.1 time: 0.375755 Sep 26 18:10:41.650812 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 378/768] 10.222.0.67 () {58 vars in 1416 bytes} [Mon Sep 26 18:10:41 2022] DELETE /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e/os-volume_attachments/403c0299-35e0-4b82-acfc-d1653a5565eb => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:10:41.661327 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-eb3ce1c6-43e1-4f3a-81f5-ef4aeafe6309 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:41.663737 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-eb3ce1c6-43e1-4f3a-81f5-ef4aeafe6309 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:41.671305 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eb3ce1c6-43e1-4f3a-81f5-ef4aeafe6309 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:41.671896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eb3ce1c6-43e1-4f3a-81f5-ef4aeafe6309 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:41.672335 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eb3ce1c6-43e1-4f3a-81f5-ef4aeafe6309 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:41.673834 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eb3ce1c6-43e1-4f3a-81f5-ef4aeafe6309 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:41.674452 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eb3ce1c6-43e1-4f3a-81f5-ef4aeafe6309 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:41.674884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-eb3ce1c6-43e1-4f3a-81f5-ef4aeafe6309 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:41.705491 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-eb3ce1c6-43e1-4f3a-81f5-ef4aeafe6309 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050019 Sep 26 18:10:41.706060 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 391/769] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:10:41 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:10:42.720039 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4edb1c8d-797e-4c51-a9ab-60e0b5d90f57 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:42.722665 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4edb1c8d-797e-4c51-a9ab-60e0b5d90f57 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:42.728927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4edb1c8d-797e-4c51-a9ab-60e0b5d90f57 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:42.729410 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4edb1c8d-797e-4c51-a9ab-60e0b5d90f57 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:42.729845 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4edb1c8d-797e-4c51-a9ab-60e0b5d90f57 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:42.730540 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4edb1c8d-797e-4c51-a9ab-60e0b5d90f57 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:42.730990 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4edb1c8d-797e-4c51-a9ab-60e0b5d90f57 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:42.731412 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4edb1c8d-797e-4c51-a9ab-60e0b5d90f57 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:42.761720 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4edb1c8d-797e-4c51-a9ab-60e0b5d90f57 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046980 Sep 26 18:10:42.762182 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 379/770] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:10:42 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:10:43.777332 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-fa1eff8d-0764-4dc8-b832-167f5639d79f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:43.779581 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-fa1eff8d-0764-4dc8-b832-167f5639d79f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:43.787749 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fa1eff8d-0764-4dc8-b832-167f5639d79f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:43.788177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fa1eff8d-0764-4dc8-b832-167f5639d79f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:43.788613 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fa1eff8d-0764-4dc8-b832-167f5639d79f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:43.789324 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fa1eff8d-0764-4dc8-b832-167f5639d79f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:43.789784 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fa1eff8d-0764-4dc8-b832-167f5639d79f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:43.790207 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fa1eff8d-0764-4dc8-b832-167f5639d79f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:43.822202 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-fa1eff8d-0764-4dc8-b832-167f5639d79f tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049145 Sep 26 18:10:43.822767 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 392/771] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:10:43 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 18:10:43.895932 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e896805f-cd82-4fe7-a7db-86ae9e58784d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:43.896716 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e896805f-cd82-4fe7-a7db-86ae9e58784d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:43.903028 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e896805f-cd82-4fe7-a7db-86ae9e58784d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:43.903512 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e896805f-cd82-4fe7-a7db-86ae9e58784d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:43.903968 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e896805f-cd82-4fe7-a7db-86ae9e58784d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:43.904673 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e896805f-cd82-4fe7-a7db-86ae9e58784d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:43.905124 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e896805f-cd82-4fe7-a7db-86ae9e58784d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:43.905665 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e896805f-cd82-4fe7-a7db-86ae9e58784d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:43.932918 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e896805f-cd82-4fe7-a7db-86ae9e58784d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Going to try to terminate instance {{(pid=121028) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:10:44.306798 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e896805f-cd82-4fe7-a7db-86ae9e58784d tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 204 len: 0 microversion: 2.1 time: 0.416041 Sep 26 18:10:44.307381 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 380/772] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:10:43 2022] DELETE /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:10:44.316774 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e73ca09a-61b9-48a7-9149-35e8014cf564 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:44.317382 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e73ca09a-61b9-48a7-9149-35e8014cf564 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:44.324197 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e73ca09a-61b9-48a7-9149-35e8014cf564 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:44.324664 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e73ca09a-61b9-48a7-9149-35e8014cf564 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:44.325107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e73ca09a-61b9-48a7-9149-35e8014cf564 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:44.325806 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e73ca09a-61b9-48a7-9149-35e8014cf564 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:44.326265 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e73ca09a-61b9-48a7-9149-35e8014cf564 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:44.326872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e73ca09a-61b9-48a7-9149-35e8014cf564 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:44.475547 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e73ca09a-61b9-48a7-9149-35e8014cf564 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:44.484446 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e73ca09a-61b9-48a7-9149-35e8014cf564 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1681 microversion: 2.1 time: 0.172542 Sep 26 18:10:44.485745 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 393/773] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:44 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:45.510347 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-bbb54811-40dc-4516-99a7-840b1fc95dbe tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:45.511035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-bbb54811-40dc-4516-99a7-840b1fc95dbe tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:45.518820 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bbb54811-40dc-4516-99a7-840b1fc95dbe tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:45.519301 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bbb54811-40dc-4516-99a7-840b1fc95dbe tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:45.519762 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bbb54811-40dc-4516-99a7-840b1fc95dbe tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:45.520462 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bbb54811-40dc-4516-99a7-840b1fc95dbe tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:45.520910 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bbb54811-40dc-4516-99a7-840b1fc95dbe tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:45.521320 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bbb54811-40dc-4516-99a7-840b1fc95dbe tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:45.666163 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-bbb54811-40dc-4516-99a7-840b1fc95dbe tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:45.674790 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-bbb54811-40dc-4516-99a7-840b1fc95dbe tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1681 microversion: 2.1 time: 0.168866 Sep 26 18:10:45.675384 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 381/774] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:45 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:46.699512 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-548daa72-2686-49e4-a463-f6354fc0b1c4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:46.700971 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-548daa72-2686-49e4-a463-f6354fc0b1c4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:46.704379 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:46.710302 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-548daa72-2686-49e4-a463-f6354fc0b1c4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:46.710787 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-548daa72-2686-49e4-a463-f6354fc0b1c4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:46.711275 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-548daa72-2686-49e4-a463-f6354fc0b1c4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:46.712032 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-548daa72-2686-49e4-a463-f6354fc0b1c4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:46.712481 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-548daa72-2686-49e4-a463-f6354fc0b1c4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:46.712918 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-548daa72-2686-49e4-a463-f6354fc0b1c4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:47.228506 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-548daa72-2686-49e4-a463-f6354fc0b1c4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:47.238602 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-548daa72-2686-49e4-a463-f6354fc0b1c4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1681 microversion: 2.1 time: 0.543114 Sep 26 18:10:47.239381 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 394/775] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:46 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1681 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:47.755380 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-5b1b5def-5c08-416b-ba8f-5f49550653ff req-f47b015f-265b-4661-8fa7-4101479b65dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a049820-82bd-4c41-8047-5f4fa2d9966e", "name": "network-vif-deleted", "tag": "0c54af98-0db2-4ce1-9deb-71251c9bce73"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:10:47.765041 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-5b1b5def-5c08-416b-ba8f-5f49550653ff req-f47b015f-265b-4661-8fa7-4101479b65dc service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:47.765518 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-5b1b5def-5c08-416b-ba8f-5f49550653ff req-f47b015f-265b-4661-8fa7-4101479b65dc service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:47.765932 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-5b1b5def-5c08-416b-ba8f-5f49550653ff req-f47b015f-265b-4661-8fa7-4101479b65dc service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:47.780557 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-5b1b5def-5c08-416b-ba8f-5f49550653ff req-f47b015f-265b-4661-8fa7-4101479b65dc service nova] Creating event network-vif-deleted:0c54af98-0db2-4ce1-9deb-71251c9bce73 for instance 7a049820-82bd-4c41-8047-5f4fa2d9966e on hv-cinder-85931 Sep 26 18:10:47.786379 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-5b1b5def-5c08-416b-ba8f-5f49550653ff req-f47b015f-265b-4661-8fa7-4101479b65dc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036028 Sep 26 18:10:47.787082 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 382/776] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:10:48.271879 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a8ba7383-755e-461e-85b3-908254cd2d65 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:48.273238 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a8ba7383-755e-461e-85b3-908254cd2d65 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:48.281581 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8ba7383-755e-461e-85b3-908254cd2d65 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:48.282393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8ba7383-755e-461e-85b3-908254cd2d65 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:48.283669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8ba7383-755e-461e-85b3-908254cd2d65 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:48.284450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8ba7383-755e-461e-85b3-908254cd2d65 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:48.285086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8ba7383-755e-461e-85b3-908254cd2d65 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:48.285817 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8ba7383-755e-461e-85b3-908254cd2d65 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:48.332926 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8ba7383-755e-461e-85b3-908254cd2d65 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:48.333818 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8ba7383-755e-461e-85b3-908254cd2d65 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:48.334631 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a8ba7383-755e-461e-85b3-908254cd2d65 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:48.335459 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-a8ba7383-755e-461e-85b3-908254cd2d65 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lazy-loading 'fault' on Instance uuid 7a049820-82bd-4c41-8047-5f4fa2d9966e {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:10:48.395637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a8ba7383-755e-461e-85b3-908254cd2d65 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bede3a601f941e7abc9fd16983679b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa58ff5197e48709d5c90ec334b9403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:48.405536 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a8ba7383-755e-461e-85b3-908254cd2d65 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 200 len: 1331 microversion: 2.1 time: 0.138628 Sep 26 18:10:48.409495 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 395/777] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:48 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 1331 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:10:49.430952 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8f210f95-9a47-4610-ba3c-98fcefcff6fb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:49.431707 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-8f210f95-9a47-4610-ba3c-98fcefcff6fb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:49.437991 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8f210f95-9a47-4610-ba3c-98fcefcff6fb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:49.438740 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8f210f95-9a47-4610-ba3c-98fcefcff6fb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:49.439178 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8f210f95-9a47-4610-ba3c-98fcefcff6fb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:49.439899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8f210f95-9a47-4610-ba3c-98fcefcff6fb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:49.440355 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8f210f95-9a47-4610-ba3c-98fcefcff6fb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:49.440812 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8f210f95-9a47-4610-ba3c-98fcefcff6fb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:49.454865 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-8f210f95-9a47-4610-ba3c-98fcefcff6fb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] HTTP exception thrown: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8f210f95-9a47-4610-ba3c-98fcefcff6fb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Request method failure captured: Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e HTTP/1.1 Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMelsNex1FlD2CBY8G-ysnjsye_l-7KQaYKxzjq-uqqw_c6lt3XOkxaeXEOSBPxdrGfGNF6J_jwjGWJdIRzcPmWbMtwg-2UVrF8ghY8jl9NOGZb0sL_3XrXpF2FeqtmN-NjzE_b12zyopUCDg2jN5eXXFmLWv81UC7SHabJvYKq1cYR8 Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:10:49.457358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:10:49.459899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:10:49.459899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:49.459899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:49.459899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:49.459899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:49.459899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:10:49.459899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:10:49.459899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 0bede3a601f941e7abc9fd16983679b2 Sep 26 18:10:49.459899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:49.459899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:10:49.459899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. Sep 26 18:10:49.459899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '7a049820-82bd-4c41-8047-5f4fa2d9966e'} Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:10:49.461266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. Sep 26 18:10:49.464122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:49.466857 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8f210f95-9a47-4610-ba3c-98fcefcff6fb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Returning 404 to user: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:10:49.466857 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8f210f95-9a47-4610-ba3c-98fcefcff6fb tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 404 len: 111 microversion: 2.1 time: 0.031752 Sep 26 18:10:49.466857 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 383/778] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:49 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:10:49.470347 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-21c91f45-4059-4176-a142-80c1a6725303 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '.version_select at 0x7f3a748bbca0>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:49.559390 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-21c91f45-4059-4176-a142-80c1a6725303 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682308213" status: 202 len: 0 microversion: 2.1 time: 0.095533 Sep 26 18:10:49.560011 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 396/779] 10.222.0.67 () {58 vars in 1221 bytes} [Mon Sep 26 18:10:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682308213 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:10:51.662520 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-31edcb75-dc65-4f51-b6fd-c675ff05cfdf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:51.663362 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-31edcb75-dc65-4f51-b6fd-c675ff05cfdf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:51.671949 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-31edcb75-dc65-4f51-b6fd-c675ff05cfdf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:51.672994 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-31edcb75-dc65-4f51-b6fd-c675ff05cfdf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:51.673673 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-31edcb75-dc65-4f51-b6fd-c675ff05cfdf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:51.674666 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-31edcb75-dc65-4f51-b6fd-c675ff05cfdf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:51.675124 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-31edcb75-dc65-4f51-b6fd-c675ff05cfdf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:51.675545 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-31edcb75-dc65-4f51-b6fd-c675ff05cfdf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:51.678448 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:51.700912 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-31edcb75-dc65-4f51-b6fd-c675ff05cfdf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] HTTP exception thrown: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-31edcb75-dc65-4f51-b6fd-c675ff05cfdf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Request method failure captured: Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: DELETE /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e HTTP/1.1 Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMelsNex1FlD2CBY8G-ysnjsye_l-7KQaYKxzjq-uqqw_c6lt3XOkxaeXEOSBPxdrGfGNF6J_jwjGWJdIRzcPmWbMtwg-2UVrF8ghY8jl9NOGZb0sL_3XrXpF2FeqtmN-NjzE_b12zyopUCDg2jN5eXXFmLWv81UC7SHabJvYKq1cYR8 Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:10:51.703517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:10:51.711747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:10:51.711747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:51.711747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:51.711747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:51.711747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:51.711747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:10:51.711747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:10:51.711747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 0bede3a601f941e7abc9fd16983679b2 Sep 26 18:10:51.711747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:51.711747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:10:51.711747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. Sep 26 18:10:51.711747 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '7a049820-82bd-4c41-8047-5f4fa2d9966e'} Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:10:51.712778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. Sep 26 18:10:51.714225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:51.715957 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-31edcb75-dc65-4f51-b6fd-c675ff05cfdf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Returning 404 to user: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:10:51.715957 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-31edcb75-dc65-4f51-b6fd-c675ff05cfdf tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 404 len: 111 microversion: 2.1 time: 0.049458 Sep 26 18:10:51.715957 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 384/780] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:10:51 2022] DELETE /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:10:51.721897 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-88f09dcb-a38b-4c75-81f2-a9d8ec43043b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:51.723155 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-88f09dcb-a38b-4c75-81f2-a9d8ec43043b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 7a049820-82bd-4c41-8047-5f4fa2d9966e] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:51.732184 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-88f09dcb-a38b-4c75-81f2-a9d8ec43043b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:51.732676 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-88f09dcb-a38b-4c75-81f2-a9d8ec43043b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:51.733113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-88f09dcb-a38b-4c75-81f2-a9d8ec43043b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:51.733815 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-88f09dcb-a38b-4c75-81f2-a9d8ec43043b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:51.734277 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-88f09dcb-a38b-4c75-81f2-a9d8ec43043b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:51.734702 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-88f09dcb-a38b-4c75-81f2-a9d8ec43043b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:51.750097 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-88f09dcb-a38b-4c75-81f2-a9d8ec43043b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] HTTP exception thrown: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-88f09dcb-a38b-4c75-81f2-a9d8ec43043b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Request method failure captured: Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e HTTP/1.1 Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMelsNex1FlD2CBY8G-ysnjsye_l-7KQaYKxzjq-uqqw_c6lt3XOkxaeXEOSBPxdrGfGNF6J_jwjGWJdIRzcPmWbMtwg-2UVrF8ghY8jl9NOGZb0sL_3XrXpF2FeqtmN-NjzE_b12zyopUCDg2jN5eXXFmLWv81UC7SHabJvYKq1cYR8 Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:10:51.752589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:10:51.754951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:10:51.754951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:51.754951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:51.754951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:51.754951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:51.754951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:10:51.754951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:10:51.754951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 0bede3a601f941e7abc9fd16983679b2 Sep 26 18:10:51.754951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:51.754951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:10:51.754951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. Sep 26 18:10:51.754951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': '7a049820-82bd-4c41-8047-5f4fa2d9966e'} Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:10:51.756448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. Sep 26 18:10:51.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:51.760916 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-88f09dcb-a38b-4c75-81f2-a9d8ec43043b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Returning 404 to user: Instance 7a049820-82bd-4c41-8047-5f4fa2d9966e could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:10:51.760916 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-88f09dcb-a38b-4c75-81f2-a9d8ec43043b tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e" status: 404 len: 111 microversion: 2.1 time: 0.039658 Sep 26 18:10:51.760916 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 397/781] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:51 2022] GET /compute/v2.1/servers/7a049820-82bd-4c41-8047-5f4fa2d9966e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:10:52.820736 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-87ee40c4-de77-4089-b040-aa14656951be tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:52.821222 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-87ee40c4-de77-4089-b040-aa14656951be tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:52.827330 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-87ee40c4-de77-4089-b040-aa14656951be tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:52.827854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-87ee40c4-de77-4089-b040-aa14656951be tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:52.828319 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-87ee40c4-de77-4089-b040-aa14656951be tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:52.829010 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-87ee40c4-de77-4089-b040-aa14656951be tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:52.829457 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-87ee40c4-de77-4089-b040-aa14656951be tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:52.829910 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-87ee40c4-de77-4089-b040-aa14656951be tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:52.856177 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-87ee40c4-de77-4089-b040-aa14656951be tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93/ips" status: 200 len: 151 microversion: 2.20 time: 0.102265 Sep 26 18:10:52.856764 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 385/782] 10.222.0.67 () {60 vars in 1289 bytes} [Mon Sep 26 18:10:52 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93/ips => generated 151 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 18:10:53.117856 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-0846b5ef-85a2-48a4-b1db-fd868b05f0f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:53.118710 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-0846b5ef-85a2-48a4-b1db-fd868b05f0f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:53.124991 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0846b5ef-85a2-48a4-b1db-fd868b05f0f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:53.125523 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0846b5ef-85a2-48a4-b1db-fd868b05f0f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:53.126077 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0846b5ef-85a2-48a4-b1db-fd868b05f0f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:53.127016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0846b5ef-85a2-48a4-b1db-fd868b05f0f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:53.127483 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0846b5ef-85a2-48a4-b1db-fd868b05f0f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:53.127930 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0846b5ef-85a2-48a4-b1db-fd868b05f0f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:53.142597 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-0846b5ef-85a2-48a4-b1db-fd868b05f0f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] HTTP exception thrown: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-0846b5ef-85a2-48a4-b1db-fd868b05f0f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Request method failure captured: Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: DELETE /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 HTTP/1.1 Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMelsNex1FlD2CBY8G-ysnjsye_l-7KQaYKxzjq-uqqw_c6lt3XOkxaeXEOSBPxdrGfGNF6J_jwjGWJdIRzcPmWbMtwg-2UVrF8ghY8jl9NOGZb0sL_3XrXpF2FeqtmN-NjzE_b12zyopUCDg2jN5eXXFmLWv81UC7SHabJvYKq1cYR8 Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:10:53.150742 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:10:53.154421 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:10:53.154421 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:53.154421 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:53.154421 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:53.154421 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:53.154421 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:10:53.154421 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:10:53.154421 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 0bede3a601f941e7abc9fd16983679b2 Sep 26 18:10:53.154421 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:53.154421 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:10:53.154421 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. Sep 26 18:10:53.154421 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': 'e8560d88-7c26-4e3c-8af6-aac7ac9aa390'} Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:10:53.155520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. Sep 26 18:10:53.157522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.158957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-0846b5ef-85a2-48a4-b1db-fd868b05f0f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Returning 404 to user: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:10:53.158957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-0846b5ef-85a2-48a4-b1db-fd868b05f0f6 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 404 len: 111 microversion: 2.1 time: 0.031894 Sep 26 18:10:53.158957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 398/783] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:10:53 2022] DELETE /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:10:53.159213 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6c14eb37-c754-4151-8b06-b26f6386bc72 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:53.159213 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-6c14eb37-c754-4151-8b06-b26f6386bc72 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: e8560d88-7c26-4e3c-8af6-aac7ac9aa390] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:53.165569 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6c14eb37-c754-4151-8b06-b26f6386bc72 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:53.166055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6c14eb37-c754-4151-8b06-b26f6386bc72 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:53.166486 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6c14eb37-c754-4151-8b06-b26f6386bc72 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:53.167484 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6c14eb37-c754-4151-8b06-b26f6386bc72 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:53.167484 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6c14eb37-c754-4151-8b06-b26f6386bc72 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:53.167484 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6c14eb37-c754-4151-8b06-b26f6386bc72 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:53.183689 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-6c14eb37-c754-4151-8b06-b26f6386bc72 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] HTTP exception thrown: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6c14eb37-c754-4151-8b06-b26f6386bc72 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Request method failure captured: Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 HTTP/1.1 Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMelsNex1FlD2CBY8G-ysnjsye_l-7KQaYKxzjq-uqqw_c6lt3XOkxaeXEOSBPxdrGfGNF6J_jwjGWJdIRzcPmWbMtwg-2UVrF8ghY8jl9NOGZb0sL_3XrXpF2FeqtmN-NjzE_b12zyopUCDg2jN5eXXFmLWv81UC7SHabJvYKq1cYR8 Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:10:53.185427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:10:53.188113 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:10:53.188113 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:53.188113 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:53.188113 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:53.188113 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:53.188113 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:10:53.188113 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:10:53.188113 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 0bede3a601f941e7abc9fd16983679b2 Sep 26 18:10:53.188113 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:53.188113 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:10:53.188113 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. Sep 26 18:10:53.188113 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': 'e8560d88-7c26-4e3c-8af6-aac7ac9aa390'} Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:10:53.189687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. Sep 26 18:10:53.191906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.194837 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6c14eb37-c754-4151-8b06-b26f6386bc72 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Returning 404 to user: Instance e8560d88-7c26-4e3c-8af6-aac7ac9aa390 could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:10:53.194837 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-6c14eb37-c754-4151-8b06-b26f6386bc72 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390" status: 404 len: 111 microversion: 2.1 time: 0.035014 Sep 26 18:10:53.194837 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 386/784] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:53 2022] GET /compute/v2.1/servers/e8560d88-7c26-4e3c-8af6-aac7ac9aa390 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:10:53.196008 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f88aca4e-689e-4349-8410-520956f7c7e4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:53.196512 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f88aca4e-689e-4349-8410-520956f7c7e4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:53.202788 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f88aca4e-689e-4349-8410-520956f7c7e4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:53.203279 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f88aca4e-689e-4349-8410-520956f7c7e4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:53.203894 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f88aca4e-689e-4349-8410-520956f7c7e4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:53.204527 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f88aca4e-689e-4349-8410-520956f7c7e4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:53.204987 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f88aca4e-689e-4349-8410-520956f7c7e4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:53.205383 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f88aca4e-689e-4349-8410-520956f7c7e4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:53.220029 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-f88aca4e-689e-4349-8410-520956f7c7e4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] HTTP exception thrown: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f88aca4e-689e-4349-8410-520956f7c7e4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Request method failure captured: Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: DELETE /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 HTTP/1.1 Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMelsNex1FlD2CBY8G-ysnjsye_l-7KQaYKxzjq-uqqw_c6lt3XOkxaeXEOSBPxdrGfGNF6J_jwjGWJdIRzcPmWbMtwg-2UVrF8ghY8jl9NOGZb0sL_3XrXpF2FeqtmN-NjzE_b12zyopUCDg2jN5eXXFmLWv81UC7SHabJvYKq1cYR8 Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:10:53.221708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:10:53.223285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:10:53.223285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:53.223285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:53.223285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:53.223285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:53.223285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:10:53.223285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:10:53.223285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 0bede3a601f941e7abc9fd16983679b2 Sep 26 18:10:53.223285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:53.223285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:10:53.223285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. Sep 26 18:10:53.223285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': '4a3d0414-434f-4d77-8bc1-57378672d4f8'} Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:10:53.227393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. Sep 26 18:10:53.229785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.232005 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f88aca4e-689e-4349-8410-520956f7c7e4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Returning 404 to user: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:10:53.232005 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f88aca4e-689e-4349-8410-520956f7c7e4 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 404 len: 111 microversion: 2.1 time: 0.031395 Sep 26 18:10:53.232005 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 399/785] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:10:53 2022] DELETE /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:10:53.232352 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3cdf5079-54e7-41ea-a23a-44b93d1a7e5e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:53.232778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-3cdf5079-54e7-41ea-a23a-44b93d1a7e5e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 4a3d0414-434f-4d77-8bc1-57378672d4f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:53.241197 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3cdf5079-54e7-41ea-a23a-44b93d1a7e5e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:53.241692 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3cdf5079-54e7-41ea-a23a-44b93d1a7e5e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:53.242129 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3cdf5079-54e7-41ea-a23a-44b93d1a7e5e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:53.243045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3cdf5079-54e7-41ea-a23a-44b93d1a7e5e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:53.243353 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3cdf5079-54e7-41ea-a23a-44b93d1a7e5e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:53.243817 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3cdf5079-54e7-41ea-a23a-44b93d1a7e5e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:53.258498 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-3cdf5079-54e7-41ea-a23a-44b93d1a7e5e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] HTTP exception thrown: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3cdf5079-54e7-41ea-a23a-44b93d1a7e5e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Request method failure captured: Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 HTTP/1.1 Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMelsNex1FlD2CBY8G-ysnjsye_l-7KQaYKxzjq-uqqw_c6lt3XOkxaeXEOSBPxdrGfGNF6J_jwjGWJdIRzcPmWbMtwg-2UVrF8ghY8jl9NOGZb0sL_3XrXpF2FeqtmN-NjzE_b12zyopUCDg2jN5eXXFmLWv81UC7SHabJvYKq1cYR8 Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:10:53.260044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:10:53.262847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:10:53.262847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:53.262847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:53.262847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:53.262847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:53.262847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:10:53.262847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:10:53.262847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 0bede3a601f941e7abc9fd16983679b2 Sep 26 18:10:53.262847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:53.262847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:10:53.262847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. Sep 26 18:10:53.262847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '4a3d0414-434f-4d77-8bc1-57378672d4f8'} Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:10:53.263815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. Sep 26 18:10:53.265247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:53.267625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3cdf5079-54e7-41ea-a23a-44b93d1a7e5e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Returning 404 to user: Instance 4a3d0414-434f-4d77-8bc1-57378672d4f8 could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:10:53.267625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-3cdf5079-54e7-41ea-a23a-44b93d1a7e5e tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8" status: 404 len: 111 microversion: 2.1 time: 0.033404 Sep 26 18:10:53.267625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 387/786] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:53 2022] GET /compute/v2.1/servers/4a3d0414-434f-4d77-8bc1-57378672d4f8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:10:54.591015 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7797a0a9-9a52-47d4-987a-db529c3e49f9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:54.591538 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7797a0a9-9a52-47d4-987a-db529c3e49f9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:54.599006 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7797a0a9-9a52-47d4-987a-db529c3e49f9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:54.599495 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7797a0a9-9a52-47d4-987a-db529c3e49f9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:54.600028 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7797a0a9-9a52-47d4-987a-db529c3e49f9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:54.600731 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7797a0a9-9a52-47d4-987a-db529c3e49f9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:54.601185 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7797a0a9-9a52-47d4-987a-db529c3e49f9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:54.601607 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7797a0a9-9a52-47d4-987a-db529c3e49f9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:54.616376 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-7797a0a9-9a52-47d4-987a-db529c3e49f9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] HTTP exception thrown: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7797a0a9-9a52-47d4-987a-db529c3e49f9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Request method failure captured: Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: DELETE /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 HTTP/1.1 Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMelsNex1FlD2CBY8G-ysnjsye_l-7KQaYKxzjq-uqqw_c6lt3XOkxaeXEOSBPxdrGfGNF6J_jwjGWJdIRzcPmWbMtwg-2UVrF8ghY8jl9NOGZb0sL_3XrXpF2FeqtmN-NjzE_b12zyopUCDg2jN5eXXFmLWv81UC7SHabJvYKq1cYR8 Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:10:54.617921 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:10:54.630403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:10:54.630403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:54.630403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:54.630403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:54.630403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:54.630403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:10:54.630403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:10:54.630403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 0bede3a601f941e7abc9fd16983679b2 Sep 26 18:10:54.630403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:54.630403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:10:54.630403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. Sep 26 18:10:54.630403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': '9682673d-b9ac-49a7-9f72-eef56dcbac73'} Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:10:54.632812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. Sep 26 18:10:54.635007 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:10:54.637235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7797a0a9-9a52-47d4-987a-db529c3e49f9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Returning 404 to user: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:10:54.637235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7797a0a9-9a52-47d4-987a-db529c3e49f9 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 404 len: 111 microversion: 2.1 time: 0.032182 Sep 26 18:10:54.637235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 400/787] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:10:54 2022] DELETE /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:10:54.643394 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-83f7952b-9383-45f7-86c3-a2c3b689ae84 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:54.643963 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-83f7952b-9383-45f7-86c3-a2c3b689ae84 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] [instance: 9682673d-b9ac-49a7-9f72-eef56dcbac73] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:54.650523 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83f7952b-9383-45f7-86c3-a2c3b689ae84 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:54.651014 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83f7952b-9383-45f7-86c3-a2c3b689ae84 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:54.651447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83f7952b-9383-45f7-86c3-a2c3b689ae84 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:54.652256 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83f7952b-9383-45f7-86c3-a2c3b689ae84 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:54.652708 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83f7952b-9383-45f7-86c3-a2c3b689ae84 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:54.657874 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-83f7952b-9383-45f7-86c3-a2c3b689ae84 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:54.669219 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-83f7952b-9383-45f7-86c3-a2c3b689ae84 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] HTTP exception thrown: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-83f7952b-9383-45f7-86c3-a2c3b689ae84 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Request method failure captured: Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 HTTP/1.1 Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMelsNex1FlD2CBY8G-ysnjsye_l-7KQaYKxzjq-uqqw_c6lt3XOkxaeXEOSBPxdrGfGNF6J_jwjGWJdIRzcPmWbMtwg-2UVrF8ghY8jl9NOGZb0sL_3XrXpF2FeqtmN-NjzE_b12zyopUCDg2jN5eXXFmLWv81UC7SHabJvYKq1cYR8 Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:10:54.671866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:10:54.674035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ffa58ff5197e48709d5c90ec334b9403"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:10:54.674035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:54.674035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: ffa58ff5197e48709d5c90ec334b9403 Sep 26 18:10:54.674035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-649719570 Sep 26 18:10:54.674035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:54.674035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:10:54.674035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:10:54.674035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 0bede3a601f941e7abc9fd16983679b2 Sep 26 18:10:54.674035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-AttachVolumeNegativeTest-649719570-project Sep 26 18:10:54.674035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:10:54.674035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. Sep 26 18:10:54.674035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '9682673d-b9ac-49a7-9f72-eef56dcbac73'} Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:10:54.675011 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. Sep 26 18:10:54.676612 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:10:54.678092 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-83f7952b-9383-45f7-86c3-a2c3b689ae84 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] Returning 404 to user: Instance 9682673d-b9ac-49a7-9f72-eef56dcbac73 could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:10:54.678092 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-83f7952b-9383-45f7-86c3-a2c3b689ae84 tempest-AttachVolumeNegativeTest-649719570 tempest-AttachVolumeNegativeTest-649719570-project] 10.222.0.67 "GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73" status: 404 len: 111 microversion: 2.1 time: 0.035785 Sep 26 18:10:54.678092 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 388/788] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:10:54 2022] GET /compute/v2.1/servers/9682673d-b9ac-49a7-9f72-eef56dcbac73 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:10:54.931505 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-cee854c2-08bd-49bf-91f0-26b814deeecb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:54.932146 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-cee854c2-08bd-49bf-91f0-26b814deeecb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:54.938529 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cee854c2-08bd-49bf-91f0-26b814deeecb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:54.939010 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cee854c2-08bd-49bf-91f0-26b814deeecb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:54.939477 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cee854c2-08bd-49bf-91f0-26b814deeecb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:54.940187 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cee854c2-08bd-49bf-91f0-26b814deeecb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:54.940659 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cee854c2-08bd-49bf-91f0-26b814deeecb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:54.941084 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cee854c2-08bd-49bf-91f0-26b814deeecb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:54.976029 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-cee854c2-08bd-49bf-91f0-26b814deeecb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/ips" status: 200 len: 147 microversion: 2.1 time: 0.048356 Sep 26 18:10:54.976620 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 401/789] 10.222.0.67 () {58 vars in 1248 bytes} [Mon Sep 26 18:10:54 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/ips => generated 147 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:10:55.339912 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e95711ee-2f98-4398-be3e-e55b021c7bc0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:10:55.340753 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e95711ee-2f98-4398-be3e-e55b021c7bc0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:55.349189 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e95711ee-2f98-4398-be3e-e55b021c7bc0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:55.349709 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e95711ee-2f98-4398-be3e-e55b021c7bc0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:55.350125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e95711ee-2f98-4398-be3e-e55b021c7bc0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:55.350828 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e95711ee-2f98-4398-be3e-e55b021c7bc0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:55.351284 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e95711ee-2f98-4398-be3e-e55b021c7bc0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:55.351800 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e95711ee-2f98-4398-be3e-e55b021c7bc0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:55.378179 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-e95711ee-2f98-4398-be3e-e55b021c7bc0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lazy-loading 'flavor' on Instance uuid 157c830f-c695-4a1a-a21f-1d0d6c24dd93 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:10:55.923529 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e95711ee-2f98-4398-be3e-e55b021c7bc0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "POST /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93/action" status: 202 len: 0 microversion: 2.20 time: 0.587401 Sep 26 18:10:55.928758 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 389/790] 10.222.0.67 () {62 vars in 1319 bytes} [Mon Sep 26 18:10:55 2022] POST /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:10:55.932558 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1b09c8d8-662c-44ef-ac86-42b4c1814896 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:55.942069 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1b09c8d8-662c-44ef-ac86-42b4c1814896 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:55.944810 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b09c8d8-662c-44ef-ac86-42b4c1814896 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:55.945361 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b09c8d8-662c-44ef-ac86-42b4c1814896 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:55.945794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b09c8d8-662c-44ef-ac86-42b4c1814896 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:55.946686 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b09c8d8-662c-44ef-ac86-42b4c1814896 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:55.947177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b09c8d8-662c-44ef-ac86-42b4c1814896 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:55.947588 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b09c8d8-662c-44ef-ac86-42b4c1814896 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:56.202816 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1b09c8d8-662c-44ef-ac86-42b4c1814896 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:56.213519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1b09c8d8-662c-44ef-ac86-42b4c1814896 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:56.214971 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1b09c8d8-662c-44ef-ac86-42b4c1814896 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:56.216298 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1b09c8d8-662c-44ef-ac86-42b4c1814896 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1723 microversion: 2.20 time: 0.287594 Sep 26 18:10:56.216927 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 402/791] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:10:55 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:10:57.250820 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c651face-93e2-440e-9f6e-3c6471668d91 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:57.271907 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c651face-93e2-440e-9f6e-3c6471668d91 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:57.301207 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c651face-93e2-440e-9f6e-3c6471668d91 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:57.301710 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c651face-93e2-440e-9f6e-3c6471668d91 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:57.302156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c651face-93e2-440e-9f6e-3c6471668d91 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:57.303526 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c651face-93e2-440e-9f6e-3c6471668d91 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:57.304046 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c651face-93e2-440e-9f6e-3c6471668d91 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:57.304478 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c651face-93e2-440e-9f6e-3c6471668d91 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:57.605770 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c651face-93e2-440e-9f6e-3c6471668d91 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:57.614414 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c651face-93e2-440e-9f6e-3c6471668d91 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:57.615873 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c651face-93e2-440e-9f6e-3c6471668d91 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:57.617016 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c651face-93e2-440e-9f6e-3c6471668d91 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1723 microversion: 2.20 time: 0.375185 Sep 26 18:10:57.617572 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 390/792] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:10:57 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1723 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:10:58.292120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bbc8aeaa-7fe4-4e0f-9a31-15c8deea5e6b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "695d61e9-ef80-40bf-aff1-7df09880f2d3"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:10:58.294647 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-bbc8aeaa-7fe4-4e0f-9a31-15c8deea5e6b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:58.303987 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbc8aeaa-7fe4-4e0f-9a31-15c8deea5e6b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:58.304593 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbc8aeaa-7fe4-4e0f-9a31-15c8deea5e6b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:58.305303 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbc8aeaa-7fe4-4e0f-9a31-15c8deea5e6b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:58.306092 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbc8aeaa-7fe4-4e0f-9a31-15c8deea5e6b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:58.307096 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbc8aeaa-7fe4-4e0f-9a31-15c8deea5e6b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:58.307757 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbc8aeaa-7fe4-4e0f-9a31-15c8deea5e6b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:58.643209 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f5cf8eba-e5ab-4d17-82f3-e156315971c8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:10:58.643841 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f5cf8eba-e5ab-4d17-82f3-e156315971c8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:10:58.650961 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5cf8eba-e5ab-4d17-82f3-e156315971c8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:58.651442 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5cf8eba-e5ab-4d17-82f3-e156315971c8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:58.652018 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5cf8eba-e5ab-4d17-82f3-e156315971c8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:58.652597 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5cf8eba-e5ab-4d17-82f3-e156315971c8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:10:58.653051 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5cf8eba-e5ab-4d17-82f3-e156315971c8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:10:58.653458 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f5cf8eba-e5ab-4d17-82f3-e156315971c8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:10:59.087192 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f5cf8eba-e5ab-4d17-82f3-e156315971c8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:59.104488 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f5cf8eba-e5ab-4d17-82f3-e156315971c8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:59.106086 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f5cf8eba-e5ab-4d17-82f3-e156315971c8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:10:59.107246 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f5cf8eba-e5ab-4d17-82f3-e156315971c8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1723 microversion: 2.20 time: 0.468608 Sep 26 18:10:59.108186 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 391/793] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:10:58 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1723 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:10:59.220825 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bbc8aeaa-7fe4-4e0f-9a31-15c8deea5e6b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "POST /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.932451 Sep 26 18:10:59.221483 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 403/794] 10.222.0.67 () {60 vars in 1323 bytes} [Mon Sep 26 18:10:58 2022] POST /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/os-volume_attachments => generated 194 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:11:00.134839 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b1ef70c8-3c51-4438-be1d-c2023b34dbeb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:00.135616 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b1ef70c8-3c51-4438-be1d-c2023b34dbeb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:00.143266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1ef70c8-3c51-4438-be1d-c2023b34dbeb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:00.143802 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1ef70c8-3c51-4438-be1d-c2023b34dbeb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:00.144245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1ef70c8-3c51-4438-be1d-c2023b34dbeb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:00.144973 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1ef70c8-3c51-4438-be1d-c2023b34dbeb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:00.145434 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1ef70c8-3c51-4438-be1d-c2023b34dbeb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:00.145960 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b1ef70c8-3c51-4438-be1d-c2023b34dbeb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:00.321059 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b1ef70c8-3c51-4438-be1d-c2023b34dbeb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:00.331864 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b1ef70c8-3c51-4438-be1d-c2023b34dbeb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:00.333476 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b1ef70c8-3c51-4438-be1d-c2023b34dbeb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:00.334780 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b1ef70c8-3c51-4438-be1d-c2023b34dbeb tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1723 microversion: 2.20 time: 0.204094 Sep 26 18:11:00.335927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 392/795] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:00 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:11:01.362845 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bb64588d-45b7-413d-8b80-a3a115337202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:01.363556 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-bb64588d-45b7-413d-8b80-a3a115337202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:01.369971 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bb64588d-45b7-413d-8b80-a3a115337202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:01.370456 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bb64588d-45b7-413d-8b80-a3a115337202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:01.370891 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bb64588d-45b7-413d-8b80-a3a115337202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:01.371664 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bb64588d-45b7-413d-8b80-a3a115337202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:01.372119 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bb64588d-45b7-413d-8b80-a3a115337202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:01.372554 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bb64588d-45b7-413d-8b80-a3a115337202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:01.516937 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bb64588d-45b7-413d-8b80-a3a115337202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:01.525957 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bb64588d-45b7-413d-8b80-a3a115337202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:01.527336 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bb64588d-45b7-413d-8b80-a3a115337202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:01.528666 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bb64588d-45b7-413d-8b80-a3a115337202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1723 microversion: 2.20 time: 0.171014 Sep 26 18:11:01.529234 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 404/796] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:01 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:02.555363 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e12ca33f-ae7e-4a0a-aeb9-f840e34dfa68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:02.555949 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e12ca33f-ae7e-4a0a-aeb9-f840e34dfa68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:02.558476 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:02.563939 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e12ca33f-ae7e-4a0a-aeb9-f840e34dfa68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:02.567338 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e12ca33f-ae7e-4a0a-aeb9-f840e34dfa68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:02.567338 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e12ca33f-ae7e-4a0a-aeb9-f840e34dfa68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:02.567338 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e12ca33f-ae7e-4a0a-aeb9-f840e34dfa68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:02.567338 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e12ca33f-ae7e-4a0a-aeb9-f840e34dfa68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:02.567939 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e12ca33f-ae7e-4a0a-aeb9-f840e34dfa68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:02.715091 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e12ca33f-ae7e-4a0a-aeb9-f840e34dfa68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:02.723324 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e12ca33f-ae7e-4a0a-aeb9-f840e34dfa68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:02.724783 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e12ca33f-ae7e-4a0a-aeb9-f840e34dfa68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:02.725914 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e12ca33f-ae7e-4a0a-aeb9-f840e34dfa68 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1723 microversion: 2.20 time: 0.174962 Sep 26 18:11:02.726466 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 393/797] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:02 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:02.919508 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-360c25c4-4fcf-4642-9873-084b501fa84e tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] Calling method '.version_select at 0x7f3a749958b0>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:02.967974 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-360c25c4-4fcf-4642-9873-084b501fa84e tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/e62984bf-1492-4e9c-ac7c-109cbbfcdc16" status: 200 len: 351 microversion: 2.1 time: 0.052099 Sep 26 18:11:02.968480 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 405/798] 10.222.0.67 () {58 vars in 1245 bytes} [Mon Sep 26 18:11:02 2022] GET /compute/v2.1/os-volumes/e62984bf-1492-4e9c-ac7c-109cbbfcdc16 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:11:03.752935 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2f451119-4462-4a24-81f7-4bd3b9f8ccd4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:03.753570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2f451119-4462-4a24-81f7-4bd3b9f8ccd4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:03.760436 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2f451119-4462-4a24-81f7-4bd3b9f8ccd4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:03.760985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2f451119-4462-4a24-81f7-4bd3b9f8ccd4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:03.761418 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2f451119-4462-4a24-81f7-4bd3b9f8ccd4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:03.762121 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2f451119-4462-4a24-81f7-4bd3b9f8ccd4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:03.762917 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2f451119-4462-4a24-81f7-4bd3b9f8ccd4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:03.763375 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2f451119-4462-4a24-81f7-4bd3b9f8ccd4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:03.910983 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2f451119-4462-4a24-81f7-4bd3b9f8ccd4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:03.920090 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2f451119-4462-4a24-81f7-4bd3b9f8ccd4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:03.921524 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2f451119-4462-4a24-81f7-4bd3b9f8ccd4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:03.923274 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2f451119-4462-4a24-81f7-4bd3b9f8ccd4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1723 microversion: 2.20 time: 0.175461 Sep 26 18:11:03.923864 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 394/799] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:03 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:04.775627 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-671b6130-3108-4261-93cc-48dc41da1972 tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] Calling method '.version_select at 0x7f3a74873160>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:04.825858 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-671b6130-3108-4261-93cc-48dc41da1972 tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/ecff1872-1aa0-44b3-842a-06827071c6f3" status: 200 len: 351 microversion: 2.1 time: 0.054693 Sep 26 18:11:04.826423 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 406/800] 10.222.0.67 () {58 vars in 1245 bytes} [Mon Sep 26 18:11:04 2022] GET /compute/v2.1/os-volumes/ecff1872-1aa0-44b3-842a-06827071c6f3 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:11:04.951331 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-bf5d072a-097b-4e15-9ae7-1b49d20bc497 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:04.952515 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-bf5d072a-097b-4e15-9ae7-1b49d20bc497 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:04.961889 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bf5d072a-097b-4e15-9ae7-1b49d20bc497 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:04.962718 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bf5d072a-097b-4e15-9ae7-1b49d20bc497 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:04.973135 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bf5d072a-097b-4e15-9ae7-1b49d20bc497 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:04.973135 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bf5d072a-097b-4e15-9ae7-1b49d20bc497 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:04.973135 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bf5d072a-097b-4e15-9ae7-1b49d20bc497 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:04.973135 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bf5d072a-097b-4e15-9ae7-1b49d20bc497 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:05.114053 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-bf5d072a-097b-4e15-9ae7-1b49d20bc497 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:05.125897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-bf5d072a-097b-4e15-9ae7-1b49d20bc497 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:05.127684 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-bf5d072a-097b-4e15-9ae7-1b49d20bc497 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:05.128883 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-bf5d072a-097b-4e15-9ae7-1b49d20bc497 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1723 microversion: 2.20 time: 0.182397 Sep 26 18:11:05.129447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 395/801] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:04 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:06.157688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-768ec4a8-77bb-43bf-b113-3e655938f202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:06.158255 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-768ec4a8-77bb-43bf-b113-3e655938f202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:06.167343 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-768ec4a8-77bb-43bf-b113-3e655938f202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:06.167872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-768ec4a8-77bb-43bf-b113-3e655938f202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:06.168350 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-768ec4a8-77bb-43bf-b113-3e655938f202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:06.169077 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-768ec4a8-77bb-43bf-b113-3e655938f202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:06.169535 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-768ec4a8-77bb-43bf-b113-3e655938f202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:06.170030 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-768ec4a8-77bb-43bf-b113-3e655938f202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:06.313090 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-768ec4a8-77bb-43bf-b113-3e655938f202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:06.321838 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-768ec4a8-77bb-43bf-b113-3e655938f202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:06.323320 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-768ec4a8-77bb-43bf-b113-3e655938f202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:06.324512 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-768ec4a8-77bb-43bf-b113-3e655938f202 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1723 microversion: 2.20 time: 0.172294 Sep 26 18:11:06.325070 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 407/802] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:06 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:06.514183 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-cf0e4653-dc20-4dd5-acca-0d29b2b9b600 tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] Calling method '.version_select at 0x7f3a782bff70>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:06.565131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-cf0e4653-dc20-4dd5-acca-0d29b2b9b600 tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/f23fd83a-9127-43b8-8d09-bb489776c581" status: 200 len: 350 microversion: 2.1 time: 0.054864 Sep 26 18:11:06.565699 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 396/803] 10.222.0.67 () {58 vars in 1245 bytes} [Mon Sep 26 18:11:06 2022] GET /compute/v2.1/os-volumes/f23fd83a-9127-43b8-8d09-bb489776c581 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:11:06.579835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d44b6108-62df-4303-95e4-c296d82f97a8 tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] Calling method '.version_select at 0x7f3a74a901f0>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:06.674308 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d44b6108-62df-4303-95e4-c296d82f97a8 tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.099183 Sep 26 18:11:06.674900 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 408/804] 10.222.0.67 () {58 vars in 1134 bytes} [Mon Sep 26 18:11:06 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:06.689892 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-0fbfe29c-eedb-4393-b92c-50616419d865 tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] Calling method '.version_select at 0x7f3a781f23a0>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:06.779630 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-0fbfe29c-eedb-4393-b92c-50616419d865 tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093810 Sep 26 18:11:06.780603 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 397/805] 10.222.0.67 () {58 vars in 1149 bytes} [Mon Sep 26 18:11:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:11:06.802038 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ddab1d62-beac-4480-ae18-e911b04bc4a0 tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] Calling method '.version_select at 0x7f3a74896430>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:06.855773 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ac3d4bca-1092-4d90-92e1-fe84a316e412 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:11:06.864221 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ac3d4bca-1092-4d90-92e1-fe84a316e412 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:06.865004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ac3d4bca-1092-4d90-92e1-fe84a316e412 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:06.865592 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ac3d4bca-1092-4d90-92e1-fe84a316e412 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:06.911776 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ddab1d62-beac-4480-ae18-e911b04bc4a0 tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.114469 Sep 26 18:11:06.912380 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 409/806] 10.222.0.67 () {58 vars in 1134 bytes} [Mon Sep 26 18:11:06 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:11:06.927365 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1969506f-5e9e-4e90-9622-74b0f40f43e7 tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] Calling method '.version_select at 0x7f3a7488a5e0>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:06.934643 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ac3d4bca-1092-4d90-92e1-fe84a316e412 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Going to try to stop instance {{(pid=121028) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 26 18:11:07.022905 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1969506f-5e9e-4e90-9622-74b0f40f43e7 tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.100160 Sep 26 18:11:07.028633 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 410/807] 10.222.0.67 () {58 vars in 1167 bytes} [Mon Sep 26 18:11:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:11:07.039068 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-fc7ec822-34b5-4c8f-8b28-dcac55dc4bec tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] Calling method '.version_select at 0x7f3a7494bee0>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:07.125788 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-fc7ec822-34b5-4c8f-8b28-dcac55dc4bec tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091555 Sep 26 18:11:07.126475 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 411/808] 10.222.0.67 () {58 vars in 1170 bytes} [Mon Sep 26 18:11:07 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:11:07.140198 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-56c99c69-e232-42cb-84b6-c9684b9e2be0 tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] Calling method '.version_select at 0x7f3a748bbf70>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:07.174094 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ac3d4bca-1092-4d90-92e1-fe84a316e412 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "POST /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/action" status: 202 len: 0 microversion: 2.1 time: 0.322442 Sep 26 18:11:07.174793 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 398/809] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Sep 26 18:11:06 2022] POST /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 18:11:07.185057 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-38784f57-cb46-47fd-b510-511413b97cf1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:07.185965 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-38784f57-cb46-47fd-b510-511413b97cf1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:07.192990 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38784f57-cb46-47fd-b510-511413b97cf1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:07.193616 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38784f57-cb46-47fd-b510-511413b97cf1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:07.194154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38784f57-cb46-47fd-b510-511413b97cf1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:07.194962 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38784f57-cb46-47fd-b510-511413b97cf1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:07.195639 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38784f57-cb46-47fd-b510-511413b97cf1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:07.196448 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-38784f57-cb46-47fd-b510-511413b97cf1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:07.228721 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-56c99c69-e232-42cb-84b6-c9684b9e2be0 tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.092117 Sep 26 18:11:07.229285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 412/810] 10.222.0.67 () {58 vars in 1155 bytes} [Mon Sep 26 18:11:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:11:07.243093 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5a2e4a8a-68ca-484b-98c6-24fd54266908 tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] Calling method '.version_select at 0x7f3a748730d0>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:07.357602 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5a2e4a8a-68ca-484b-98c6-24fd54266908 tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.118271 Sep 26 18:11:07.358163 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 413/811] 10.222.0.67 () {58 vars in 1188 bytes} [Mon Sep 26 18:11:07 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:11:07.363149 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ce6113c7-24e2-43c7-aecf-93c753dd812b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:07.363920 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ce6113c7-24e2-43c7-aecf-93c753dd812b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:07.365380 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-38784f57-cb46-47fd-b510-511413b97cf1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:07.372094 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ce6113c7-24e2-43c7-aecf-93c753dd812b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:07.372665 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ce6113c7-24e2-43c7-aecf-93c753dd812b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:07.373548 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ce6113c7-24e2-43c7-aecf-93c753dd812b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:07.374600 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ce6113c7-24e2-43c7-aecf-93c753dd812b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:07.375850 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ce6113c7-24e2-43c7-aecf-93c753dd812b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:07.376515 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ce6113c7-24e2-43c7-aecf-93c753dd812b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:07.378527 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-38784f57-cb46-47fd-b510-511413b97cf1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1725 microversion: 2.1 time: 0.198490 Sep 26 18:11:07.392110 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 399/812] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:07 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:11:07.399900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4d7401c2-5dee-4444-9015-b39a97c2182a tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] Calling method '.version_select at 0x7f3a78201940>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:07.489750 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4d7401c2-5dee-4444-9015-b39a97c2182a tempest-VolumesTestJSON-43073322 tempest-VolumesTestJSON-43073322-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.094912 Sep 26 18:11:07.490426 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 400/813] 10.222.0.67 () {58 vars in 1155 bytes} [Mon Sep 26 18:11:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:07.529297 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ce6113c7-24e2-43c7-aecf-93c753dd812b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:07.538084 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ce6113c7-24e2-43c7-aecf-93c753dd812b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:07.539556 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ce6113c7-24e2-43c7-aecf-93c753dd812b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:07.541003 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ce6113c7-24e2-43c7-aecf-93c753dd812b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1723 microversion: 2.20 time: 0.181577 Sep 26 18:11:07.541578 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 414/814] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:07 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:08.407265 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-31a7e2ba-9ab3-4a64-97fe-0231831e74d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:08.408419 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-31a7e2ba-9ab3-4a64-97fe-0231831e74d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:08.415873 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-31a7e2ba-9ab3-4a64-97fe-0231831e74d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:08.416359 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-31a7e2ba-9ab3-4a64-97fe-0231831e74d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:08.416794 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-31a7e2ba-9ab3-4a64-97fe-0231831e74d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:08.417576 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-31a7e2ba-9ab3-4a64-97fe-0231831e74d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:08.418021 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-31a7e2ba-9ab3-4a64-97fe-0231831e74d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:08.418438 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-31a7e2ba-9ab3-4a64-97fe-0231831e74d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:08.569157 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-dec13475-ac87-4f32-831b-f3ca5de29109 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:08.569810 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-dec13475-ac87-4f32-831b-f3ca5de29109 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:08.573079 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-31a7e2ba-9ab3-4a64-97fe-0231831e74d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:08.583694 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dec13475-ac87-4f32-831b-f3ca5de29109 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:08.583694 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dec13475-ac87-4f32-831b-f3ca5de29109 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:08.583694 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dec13475-ac87-4f32-831b-f3ca5de29109 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:08.583694 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dec13475-ac87-4f32-831b-f3ca5de29109 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:08.584137 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dec13475-ac87-4f32-831b-f3ca5de29109 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:08.584137 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dec13475-ac87-4f32-831b-f3ca5de29109 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:08.584306 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-31a7e2ba-9ab3-4a64-97fe-0231831e74d5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1725 microversion: 2.1 time: 0.181570 Sep 26 18:11:08.585029 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 401/815] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:08 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:08.744712 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-dec13475-ac87-4f32-831b-f3ca5de29109 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:08.753994 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-dec13475-ac87-4f32-831b-f3ca5de29109 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:08.755468 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-dec13475-ac87-4f32-831b-f3ca5de29109 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:08.756673 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-dec13475-ac87-4f32-831b-f3ca5de29109 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1723 microversion: 2.20 time: 0.192086 Sep 26 18:11:08.757239 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 415/816] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:08 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:09.617024 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-98de0f3e-51d3-493a-a3ab-d175484e35de tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:09.617689 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-98de0f3e-51d3-493a-a3ab-d175484e35de tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:09.624306 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-98de0f3e-51d3-493a-a3ab-d175484e35de tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:09.624948 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-98de0f3e-51d3-493a-a3ab-d175484e35de tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:09.625538 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-98de0f3e-51d3-493a-a3ab-d175484e35de tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:09.626262 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-98de0f3e-51d3-493a-a3ab-d175484e35de tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:09.626762 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-98de0f3e-51d3-493a-a3ab-d175484e35de tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:09.627187 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-98de0f3e-51d3-493a-a3ab-d175484e35de tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:09.774677 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-98de0f3e-51d3-493a-a3ab-d175484e35de tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:09.784058 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-23005c89-9f6b-4bac-bdfc-949e01d4d604 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:09.784928 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-23005c89-9f6b-4bac-bdfc-949e01d4d604 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:09.785213 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-98de0f3e-51d3-493a-a3ab-d175484e35de tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1725 microversion: 2.1 time: 0.172068 Sep 26 18:11:09.785814 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 402/817] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:09 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:09.791853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-23005c89-9f6b-4bac-bdfc-949e01d4d604 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:09.792346 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-23005c89-9f6b-4bac-bdfc-949e01d4d604 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:09.792782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-23005c89-9f6b-4bac-bdfc-949e01d4d604 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:09.793490 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-23005c89-9f6b-4bac-bdfc-949e01d4d604 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:09.793941 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-23005c89-9f6b-4bac-bdfc-949e01d4d604 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:09.794367 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-23005c89-9f6b-4bac-bdfc-949e01d4d604 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:09.954154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-23005c89-9f6b-4bac-bdfc-949e01d4d604 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:09.963466 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-23005c89-9f6b-4bac-bdfc-949e01d4d604 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:09.964579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-23005c89-9f6b-4bac-bdfc-949e01d4d604 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:09.965741 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-23005c89-9f6b-4bac-bdfc-949e01d4d604 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1723 microversion: 2.20 time: 0.186700 Sep 26 18:11:09.966296 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 416/818] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:09 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:11:10.809431 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3b9e9e55-0380-4a85-af68-dc3c389895bb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:10.810150 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-3b9e9e55-0380-4a85-af68-dc3c389895bb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:10.817271 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b9e9e55-0380-4a85-af68-dc3c389895bb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:10.817753 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b9e9e55-0380-4a85-af68-dc3c389895bb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:10.818181 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b9e9e55-0380-4a85-af68-dc3c389895bb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:10.818871 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b9e9e55-0380-4a85-af68-dc3c389895bb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:10.819321 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b9e9e55-0380-4a85-af68-dc3c389895bb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:10.819773 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3b9e9e55-0380-4a85-af68-dc3c389895bb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:10.957635 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3b9e9e55-0380-4a85-af68-dc3c389895bb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:10.960058 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:10.967089 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-3b9e9e55-0380-4a85-af68-dc3c389895bb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1725 microversion: 2.1 time: 0.161550 Sep 26 18:11:10.967742 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 403/819] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:10 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:10.993532 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-cf2b0709-8da8-4bd8-a14e-c233db51e996 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:10.994445 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-cf2b0709-8da8-4bd8-a14e-c233db51e996 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:11.001572 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cf2b0709-8da8-4bd8-a14e-c233db51e996 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:11.003874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cf2b0709-8da8-4bd8-a14e-c233db51e996 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:11.003874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cf2b0709-8da8-4bd8-a14e-c233db51e996 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:11.003874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cf2b0709-8da8-4bd8-a14e-c233db51e996 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:11.003874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cf2b0709-8da8-4bd8-a14e-c233db51e996 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:11.004450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cf2b0709-8da8-4bd8-a14e-c233db51e996 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:11.144788 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-cf2b0709-8da8-4bd8-a14e-c233db51e996 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:11.148393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:11.153726 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-cf2b0709-8da8-4bd8-a14e-c233db51e996 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:11.155180 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-cf2b0709-8da8-4bd8-a14e-c233db51e996 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:11.156919 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-cf2b0709-8da8-4bd8-a14e-c233db51e996 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1723 microversion: 2.20 time: 0.167141 Sep 26 18:11:11.157548 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 417/820] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:10 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:11.992193 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-20ad3875-89cd-4cd4-b129-cf8606ec0d76 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:11.992800 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-20ad3875-89cd-4cd4-b129-cf8606ec0d76 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:11.999913 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-20ad3875-89cd-4cd4-b129-cf8606ec0d76 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:12.011552 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-20ad3875-89cd-4cd4-b129-cf8606ec0d76 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:12.011552 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-20ad3875-89cd-4cd4-b129-cf8606ec0d76 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:12.011552 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-20ad3875-89cd-4cd4-b129-cf8606ec0d76 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:12.011552 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-20ad3875-89cd-4cd4-b129-cf8606ec0d76 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:12.012185 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-20ad3875-89cd-4cd4-b129-cf8606ec0d76 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:12.144812 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-20ad3875-89cd-4cd4-b129-cf8606ec0d76 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:12.153262 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-20ad3875-89cd-4cd4-b129-cf8606ec0d76 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1725 microversion: 2.1 time: 0.165220 Sep 26 18:11:12.153853 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 404/821] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:11 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:12.183588 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a675620d-535f-4cb0-b570-19bcca043164 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:12.184278 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a675620d-535f-4cb0-b570-19bcca043164 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:12.192450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a675620d-535f-4cb0-b570-19bcca043164 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:12.192951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a675620d-535f-4cb0-b570-19bcca043164 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:12.193390 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a675620d-535f-4cb0-b570-19bcca043164 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:12.194117 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a675620d-535f-4cb0-b570-19bcca043164 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:12.194584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a675620d-535f-4cb0-b570-19bcca043164 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:12.195005 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a675620d-535f-4cb0-b570-19bcca043164 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:12.342385 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a675620d-535f-4cb0-b570-19bcca043164 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:12.351165 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a675620d-535f-4cb0-b570-19bcca043164 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:12.352656 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a675620d-535f-4cb0-b570-19bcca043164 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:12.353818 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a675620d-535f-4cb0-b570-19bcca043164 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1744 microversion: 2.20 time: 0.174091 Sep 26 18:11:12.354351 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 418/822] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:12 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:11:13.179526 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a332e4ab-6a64-4ce5-9fc2-33e22e29a082 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:13.180371 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a332e4ab-6a64-4ce5-9fc2-33e22e29a082 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:13.188548 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a332e4ab-6a64-4ce5-9fc2-33e22e29a082 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:13.189225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a332e4ab-6a64-4ce5-9fc2-33e22e29a082 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:13.189788 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a332e4ab-6a64-4ce5-9fc2-33e22e29a082 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:13.190700 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a332e4ab-6a64-4ce5-9fc2-33e22e29a082 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:13.191328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a332e4ab-6a64-4ce5-9fc2-33e22e29a082 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:13.191985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a332e4ab-6a64-4ce5-9fc2-33e22e29a082 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:13.333795 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a332e4ab-6a64-4ce5-9fc2-33e22e29a082 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:13.342228 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a332e4ab-6a64-4ce5-9fc2-33e22e29a082 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1725 microversion: 2.1 time: 0.167925 Sep 26 18:11:13.346425 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 405/823] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:13 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:13.384465 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-4be56861-862c-4650-b8b4-88a6441d7875 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:13.385108 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-4be56861-862c-4650-b8b4-88a6441d7875 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:13.393041 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4be56861-862c-4650-b8b4-88a6441d7875 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:13.393530 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4be56861-862c-4650-b8b4-88a6441d7875 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:13.393960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4be56861-862c-4650-b8b4-88a6441d7875 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:13.394655 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4be56861-862c-4650-b8b4-88a6441d7875 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:13.395108 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4be56861-862c-4650-b8b4-88a6441d7875 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:13.395531 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4be56861-862c-4650-b8b4-88a6441d7875 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:13.556086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-4be56861-862c-4650-b8b4-88a6441d7875 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:13.565944 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-4be56861-862c-4650-b8b4-88a6441d7875 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:13.567444 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-4be56861-862c-4650-b8b4-88a6441d7875 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:13.568708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-4be56861-862c-4650-b8b4-88a6441d7875 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1744 microversion: 2.20 time: 0.188068 Sep 26 18:11:13.569555 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 419/824] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:13 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:14.366177 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-dc8c0eee-ab3a-4dec-9fbc-5d2c4796c633 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:14.367379 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-dc8c0eee-ab3a-4dec-9fbc-5d2c4796c633 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:14.374576 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dc8c0eee-ab3a-4dec-9fbc-5d2c4796c633 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:14.375324 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dc8c0eee-ab3a-4dec-9fbc-5d2c4796c633 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:14.375968 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dc8c0eee-ab3a-4dec-9fbc-5d2c4796c633 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:14.376947 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dc8c0eee-ab3a-4dec-9fbc-5d2c4796c633 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:14.377601 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dc8c0eee-ab3a-4dec-9fbc-5d2c4796c633 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:14.378175 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dc8c0eee-ab3a-4dec-9fbc-5d2c4796c633 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:14.533224 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-dc8c0eee-ab3a-4dec-9fbc-5d2c4796c633 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:14.548190 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-dc8c0eee-ab3a-4dec-9fbc-5d2c4796c633 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1725 microversion: 2.1 time: 0.185557 Sep 26 18:11:14.549056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 406/825] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:14 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:14.596841 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-878c978c-7d07-4e59-aeb1-6aeb0f5950fa tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:14.597576 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-878c978c-7d07-4e59-aeb1-6aeb0f5950fa tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:14.606624 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-878c978c-7d07-4e59-aeb1-6aeb0f5950fa tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:14.607328 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-878c978c-7d07-4e59-aeb1-6aeb0f5950fa tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:14.607980 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-878c978c-7d07-4e59-aeb1-6aeb0f5950fa tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:14.608707 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-878c978c-7d07-4e59-aeb1-6aeb0f5950fa tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:14.609232 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-878c978c-7d07-4e59-aeb1-6aeb0f5950fa tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:14.609729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-878c978c-7d07-4e59-aeb1-6aeb0f5950fa tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:14.773225 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-878c978c-7d07-4e59-aeb1-6aeb0f5950fa tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:14.785667 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-878c978c-7d07-4e59-aeb1-6aeb0f5950fa tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:14.786988 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-878c978c-7d07-4e59-aeb1-6aeb0f5950fa tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:14.788204 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-878c978c-7d07-4e59-aeb1-6aeb0f5950fa tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1739 microversion: 2.20 time: 0.197981 Sep 26 18:11:14.788765 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 420/826] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:14 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:15.579632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e90ca5cd-0132-4750-80bf-8e6224b60447 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:15.580331 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e90ca5cd-0132-4750-80bf-8e6224b60447 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:15.591232 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e90ca5cd-0132-4750-80bf-8e6224b60447 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:15.592415 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e90ca5cd-0132-4750-80bf-8e6224b60447 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:15.592869 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e90ca5cd-0132-4750-80bf-8e6224b60447 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:15.593600 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e90ca5cd-0132-4750-80bf-8e6224b60447 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:15.594103 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e90ca5cd-0132-4750-80bf-8e6224b60447 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:15.594500 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e90ca5cd-0132-4750-80bf-8e6224b60447 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:15.820189 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bea79bab-af2a-40c6-8f44-946517949ef8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:15.822177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-bea79bab-af2a-40c6-8f44-946517949ef8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:15.833880 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bea79bab-af2a-40c6-8f44-946517949ef8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:15.834713 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bea79bab-af2a-40c6-8f44-946517949ef8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:15.835162 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bea79bab-af2a-40c6-8f44-946517949ef8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:15.836257 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bea79bab-af2a-40c6-8f44-946517949ef8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:15.837403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bea79bab-af2a-40c6-8f44-946517949ef8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:15.838123 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bea79bab-af2a-40c6-8f44-946517949ef8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:16.080423 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e90ca5cd-0132-4750-80bf-8e6224b60447 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:16.091488 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e90ca5cd-0132-4750-80bf-8e6224b60447 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1725 microversion: 2.1 time: 0.516305 Sep 26 18:11:16.092474 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 407/827] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:15 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1725 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:16.160908 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bea79bab-af2a-40c6-8f44-946517949ef8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:16.171290 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bea79bab-af2a-40c6-8f44-946517949ef8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:16.174136 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bea79bab-af2a-40c6-8f44-946517949ef8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:16.175925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bea79bab-af2a-40c6-8f44-946517949ef8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1739 microversion: 2.20 time: 0.360246 Sep 26 18:11:16.177021 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 421/828] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:15 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1739 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:16.950004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-47ce0afb-fde8-474d-ac47-8c23c003cdda req-f71d2c56-6b96-4b2b-8bcc-8192102e876b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157c830f-c695-4a1a-a21f-1d0d6c24dd93", "name": "network-vif-plugged", "status": "completed", "tag": "4810d7ad-3670-4d57-835a-ea0d6344ef48"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:11:16.979288 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-47ce0afb-fde8-474d-ac47-8c23c003cdda req-f71d2c56-6b96-4b2b-8bcc-8192102e876b service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:16.980444 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-47ce0afb-fde8-474d-ac47-8c23c003cdda req-f71d2c56-6b96-4b2b-8bcc-8192102e876b service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:16.982540 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-47ce0afb-fde8-474d-ac47-8c23c003cdda req-f71d2c56-6b96-4b2b-8bcc-8192102e876b service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:17.034131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-47ce0afb-fde8-474d-ac47-8c23c003cdda req-f71d2c56-6b96-4b2b-8bcc-8192102e876b service nova] Creating event network-vif-plugged:4810d7ad-3670-4d57-835a-ea0d6344ef48 for instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 on hv-cinder-85931 Sep 26 18:11:17.055327 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-47ce0afb-fde8-474d-ac47-8c23c003cdda req-f71d2c56-6b96-4b2b-8bcc-8192102e876b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121077 Sep 26 18:11:17.056932 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 408/829] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:11:17.118642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-982ff060-9d3a-4855-90a3-c2ac68988e8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:17.120402 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-982ff060-9d3a-4855-90a3-c2ac68988e8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:17.130767 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:17.132815 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-982ff060-9d3a-4855-90a3-c2ac68988e8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:17.133569 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-982ff060-9d3a-4855-90a3-c2ac68988e8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:17.137903 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-982ff060-9d3a-4855-90a3-c2ac68988e8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:17.137903 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-982ff060-9d3a-4855-90a3-c2ac68988e8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:17.137903 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-982ff060-9d3a-4855-90a3-c2ac68988e8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:17.137903 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-982ff060-9d3a-4855-90a3-c2ac68988e8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:17.207535 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b558b165-27c4-44db-94c0-79abdf2ff339 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:17.221233 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b558b165-27c4-44db-94c0-79abdf2ff339 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:17.242113 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b558b165-27c4-44db-94c0-79abdf2ff339 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:17.243615 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b558b165-27c4-44db-94c0-79abdf2ff339 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:17.245631 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b558b165-27c4-44db-94c0-79abdf2ff339 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:17.246990 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b558b165-27c4-44db-94c0-79abdf2ff339 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:17.254603 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b558b165-27c4-44db-94c0-79abdf2ff339 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:17.255595 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b558b165-27c4-44db-94c0-79abdf2ff339 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:17.418149 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-982ff060-9d3a-4855-90a3-c2ac68988e8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:17.435205 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-982ff060-9d3a-4855-90a3-c2ac68988e8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1725 microversion: 2.1 time: 0.322237 Sep 26 18:11:17.435688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 422/830] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:17 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1725 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:17.541354 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b558b165-27c4-44db-94c0-79abdf2ff339 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:17.553721 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b558b165-27c4-44db-94c0-79abdf2ff339 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:17.555164 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b558b165-27c4-44db-94c0-79abdf2ff339 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:17.556617 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b558b165-27c4-44db-94c0-79abdf2ff339 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1739 microversion: 2.20 time: 0.357452 Sep 26 18:11:17.558141 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 409/831] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:17 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1739 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:18.460024 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-00c69d0d-7c68-40c7-982f-7ebd3ad086ec tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:18.460781 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-00c69d0d-7c68-40c7-982f-7ebd3ad086ec tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:18.468371 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00c69d0d-7c68-40c7-982f-7ebd3ad086ec tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:18.469648 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00c69d0d-7c68-40c7-982f-7ebd3ad086ec tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:18.470135 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00c69d0d-7c68-40c7-982f-7ebd3ad086ec tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:18.470857 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00c69d0d-7c68-40c7-982f-7ebd3ad086ec tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:18.471467 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00c69d0d-7c68-40c7-982f-7ebd3ad086ec tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:18.471943 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-00c69d0d-7c68-40c7-982f-7ebd3ad086ec tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:18.743210 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ce08162d-a87c-4250-8269-ee6069462c8a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:18.743210 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ce08162d-a87c-4250-8269-ee6069462c8a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:18.743210 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce08162d-a87c-4250-8269-ee6069462c8a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:18.743210 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce08162d-a87c-4250-8269-ee6069462c8a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:18.743981 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce08162d-a87c-4250-8269-ee6069462c8a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:18.743981 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce08162d-a87c-4250-8269-ee6069462c8a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:18.743981 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce08162d-a87c-4250-8269-ee6069462c8a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:18.743981 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce08162d-a87c-4250-8269-ee6069462c8a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:18.744286 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-00c69d0d-7c68-40c7-982f-7ebd3ad086ec tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:18.744286 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-00c69d0d-7c68-40c7-982f-7ebd3ad086ec tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1725 microversion: 2.1 time: 0.171995 Sep 26 18:11:18.744286 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 423/832] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:18 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:18.759953 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ce08162d-a87c-4250-8269-ee6069462c8a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:18.768819 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ce08162d-a87c-4250-8269-ee6069462c8a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:18.770224 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ce08162d-a87c-4250-8269-ee6069462c8a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:18.771372 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ce08162d-a87c-4250-8269-ee6069462c8a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1739 microversion: 2.20 time: 0.189256 Sep 26 18:11:18.771955 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 410/833] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:18 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:11:19.769686 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-93f80779-61f7-4d6b-bf42-e619473b6d28 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:19.770190 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-93f80779-61f7-4d6b-bf42-e619473b6d28 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:19.782359 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93f80779-61f7-4d6b-bf42-e619473b6d28 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:19.783361 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93f80779-61f7-4d6b-bf42-e619473b6d28 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:19.784106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93f80779-61f7-4d6b-bf42-e619473b6d28 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:19.785501 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93f80779-61f7-4d6b-bf42-e619473b6d28 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:19.786750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93f80779-61f7-4d6b-bf42-e619473b6d28 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:19.787566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93f80779-61f7-4d6b-bf42-e619473b6d28 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:19.799635 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4c0a28e0-a8ed-44ea-8f8f-44786ece330b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:19.800982 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4c0a28e0-a8ed-44ea-8f8f-44786ece330b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:19.810922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4c0a28e0-a8ed-44ea-8f8f-44786ece330b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:19.816737 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4c0a28e0-a8ed-44ea-8f8f-44786ece330b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:19.817414 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4c0a28e0-a8ed-44ea-8f8f-44786ece330b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:19.818346 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4c0a28e0-a8ed-44ea-8f8f-44786ece330b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:19.822454 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4c0a28e0-a8ed-44ea-8f8f-44786ece330b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:19.823757 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4c0a28e0-a8ed-44ea-8f8f-44786ece330b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:20.210426 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-4c0a28e0-a8ed-44ea-8f8f-44786ece330b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:20.224545 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-4c0a28e0-a8ed-44ea-8f8f-44786ece330b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:20.226865 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-4c0a28e0-a8ed-44ea-8f8f-44786ece330b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:20.228680 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4c0a28e0-a8ed-44ea-8f8f-44786ece330b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1739 microversion: 2.20 time: 0.435190 Sep 26 18:11:20.244211 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-93f80779-61f7-4d6b-bf42-e619473b6d28 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:20.244741 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 411/834] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:19 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1739 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:20.249443 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-93f80779-61f7-4d6b-bf42-e619473b6d28 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1725 microversion: 2.1 time: 0.484646 Sep 26 18:11:20.251060 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 424/835] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:19 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1725 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:21.264095 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-71b8fba8-fea0-47ab-8cbd-35e8d314c295 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:21.264691 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-71b8fba8-fea0-47ab-8cbd-35e8d314c295 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:21.275083 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-71b8fba8-fea0-47ab-8cbd-35e8d314c295 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:21.281048 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-71b8fba8-fea0-47ab-8cbd-35e8d314c295 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:21.282760 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-71b8fba8-fea0-47ab-8cbd-35e8d314c295 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:21.283778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-71b8fba8-fea0-47ab-8cbd-35e8d314c295 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:21.284450 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-71b8fba8-fea0-47ab-8cbd-35e8d314c295 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:21.285242 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-71b8fba8-fea0-47ab-8cbd-35e8d314c295 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:21.289009 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-3270ffba-9a8b-4781-9537-bd7f156fdaa5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:21.296110 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3270ffba-9a8b-4781-9537-bd7f156fdaa5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:21.315242 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3270ffba-9a8b-4781-9537-bd7f156fdaa5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:21.316082 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3270ffba-9a8b-4781-9537-bd7f156fdaa5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:21.317766 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3270ffba-9a8b-4781-9537-bd7f156fdaa5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:21.321159 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3270ffba-9a8b-4781-9537-bd7f156fdaa5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:21.321931 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3270ffba-9a8b-4781-9537-bd7f156fdaa5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:21.322659 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3270ffba-9a8b-4781-9537-bd7f156fdaa5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:21.583435 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3270ffba-9a8b-4781-9537-bd7f156fdaa5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:21.595479 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-3270ffba-9a8b-4781-9537-bd7f156fdaa5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1725 microversion: 2.1 time: 0.318710 Sep 26 18:11:21.596334 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 425/836] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:21 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1725 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:21.626632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-71b8fba8-fea0-47ab-8cbd-35e8d314c295 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:21.638370 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-71b8fba8-fea0-47ab-8cbd-35e8d314c295 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:21.640536 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-71b8fba8-fea0-47ab-8cbd-35e8d314c295 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:21.643713 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-71b8fba8-fea0-47ab-8cbd-35e8d314c295 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1739 microversion: 2.20 time: 0.384712 Sep 26 18:11:21.662872 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 412/837] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:21 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1739 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:22.619168 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-4496b356-a428-4dc7-ac3b-661f63c8f068 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:22.619909 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-4496b356-a428-4dc7-ac3b-661f63c8f068 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:22.626546 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4496b356-a428-4dc7-ac3b-661f63c8f068 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:22.627162 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4496b356-a428-4dc7-ac3b-661f63c8f068 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:22.627824 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4496b356-a428-4dc7-ac3b-661f63c8f068 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:22.631792 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4496b356-a428-4dc7-ac3b-661f63c8f068 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:22.633066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4496b356-a428-4dc7-ac3b-661f63c8f068 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:22.633752 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4496b356-a428-4dc7-ac3b-661f63c8f068 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:22.673665 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-bc6bf9d7-573c-4634-bda5-345899624517 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:22.674401 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-bc6bf9d7-573c-4634-bda5-345899624517 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:22.681078 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc6bf9d7-573c-4634-bda5-345899624517 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:22.681570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc6bf9d7-573c-4634-bda5-345899624517 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:22.682005 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc6bf9d7-573c-4634-bda5-345899624517 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:22.682706 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc6bf9d7-573c-4634-bda5-345899624517 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:22.683165 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc6bf9d7-573c-4634-bda5-345899624517 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:22.683595 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bc6bf9d7-573c-4634-bda5-345899624517 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:22.852770 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-4496b356-a428-4dc7-ac3b-661f63c8f068 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:22.862301 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-4496b356-a428-4dc7-ac3b-661f63c8f068 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1725 microversion: 2.1 time: 0.247264 Sep 26 18:11:22.862872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 426/838] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:22 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1725 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:11:22.887050 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-bc6bf9d7-573c-4634-bda5-345899624517 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:22.896911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-bc6bf9d7-573c-4634-bda5-345899624517 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:22.898428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-bc6bf9d7-573c-4634-bda5-345899624517 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:22.899594 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-bc6bf9d7-573c-4634-bda5-345899624517 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1739 microversion: 2.20 time: 0.229996 Sep 26 18:11:22.910149 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 413/839] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:22 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:11:23.886372 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-050f7f35-921d-4425-b9d1-35a5b544508d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:23.887595 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-050f7f35-921d-4425-b9d1-35a5b544508d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:23.894689 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-050f7f35-921d-4425-b9d1-35a5b544508d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:23.895188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-050f7f35-921d-4425-b9d1-35a5b544508d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:23.895631 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-050f7f35-921d-4425-b9d1-35a5b544508d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:23.896399 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-050f7f35-921d-4425-b9d1-35a5b544508d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:23.896848 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-050f7f35-921d-4425-b9d1-35a5b544508d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:23.897282 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-050f7f35-921d-4425-b9d1-35a5b544508d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:23.934354 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8aa778e7-4287-4100-89df-bedd75336ff9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:23.935116 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-8aa778e7-4287-4100-89df-bedd75336ff9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:23.958680 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8aa778e7-4287-4100-89df-bedd75336ff9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:23.959203 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8aa778e7-4287-4100-89df-bedd75336ff9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:23.959765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8aa778e7-4287-4100-89df-bedd75336ff9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:23.960799 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8aa778e7-4287-4100-89df-bedd75336ff9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:23.961430 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8aa778e7-4287-4100-89df-bedd75336ff9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:23.962025 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8aa778e7-4287-4100-89df-bedd75336ff9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:24.261955 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-050f7f35-921d-4425-b9d1-35a5b544508d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:24.277411 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-050f7f35-921d-4425-b9d1-35a5b544508d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1725 microversion: 2.1 time: 0.394711 Sep 26 18:11:24.282136 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 427/840] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:23 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1725 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:24.298106 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8aa778e7-4287-4100-89df-bedd75336ff9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:24.306500 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8aa778e7-4287-4100-89df-bedd75336ff9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:24.308330 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8aa778e7-4287-4100-89df-bedd75336ff9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:24.309711 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8aa778e7-4287-4100-89df-bedd75336ff9 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1739 microversion: 2.20 time: 0.379237 Sep 26 18:11:24.335197 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 414/841] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:23 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1739 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:11:25.306705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e7ebd29f-2f10-41f8-a5e4-00e07d9d99ba tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:25.308128 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e7ebd29f-2f10-41f8-a5e4-00e07d9d99ba tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:25.315966 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e7ebd29f-2f10-41f8-a5e4-00e07d9d99ba tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:25.317315 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e7ebd29f-2f10-41f8-a5e4-00e07d9d99ba tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:25.319263 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e7ebd29f-2f10-41f8-a5e4-00e07d9d99ba tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:25.320896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e7ebd29f-2f10-41f8-a5e4-00e07d9d99ba tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:25.324390 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e7ebd29f-2f10-41f8-a5e4-00e07d9d99ba tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:25.325754 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e7ebd29f-2f10-41f8-a5e4-00e07d9d99ba tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:25.352692 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c0cf2743-cad0-46c8-932e-38671dd12ca3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:25.354836 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c0cf2743-cad0-46c8-932e-38671dd12ca3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:25.368880 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c0cf2743-cad0-46c8-932e-38671dd12ca3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:25.371103 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c0cf2743-cad0-46c8-932e-38671dd12ca3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:25.372035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c0cf2743-cad0-46c8-932e-38671dd12ca3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:25.373220 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c0cf2743-cad0-46c8-932e-38671dd12ca3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:25.374268 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c0cf2743-cad0-46c8-932e-38671dd12ca3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:25.374934 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c0cf2743-cad0-46c8-932e-38671dd12ca3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:25.661163 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e7ebd29f-2f10-41f8-a5e4-00e07d9d99ba tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:25.671452 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e7ebd29f-2f10-41f8-a5e4-00e07d9d99ba tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1725 microversion: 2.1 time: 0.370331 Sep 26 18:11:25.672404 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 428/842] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:25 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1725 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:11:25.701535 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c0cf2743-cad0-46c8-932e-38671dd12ca3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:25.733012 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c0cf2743-cad0-46c8-932e-38671dd12ca3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:25.741568 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c0cf2743-cad0-46c8-932e-38671dd12ca3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:25.741568 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c0cf2743-cad0-46c8-932e-38671dd12ca3 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1739 microversion: 2.20 time: 0.398453 Sep 26 18:11:25.743094 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 415/843] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:25 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1739 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:11:26.698893 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c9abc39c-17e6-4978-99e8-71935accc35c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:26.699521 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c9abc39c-17e6-4978-99e8-71935accc35c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:26.706728 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c9abc39c-17e6-4978-99e8-71935accc35c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:26.707226 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c9abc39c-17e6-4978-99e8-71935accc35c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:26.707705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c9abc39c-17e6-4978-99e8-71935accc35c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:26.708441 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c9abc39c-17e6-4978-99e8-71935accc35c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:26.708909 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c9abc39c-17e6-4978-99e8-71935accc35c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:26.709352 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c9abc39c-17e6-4978-99e8-71935accc35c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:26.770172 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-64a13431-7894-46ea-92ca-1d63954aa04f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:26.770976 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-64a13431-7894-46ea-92ca-1d63954aa04f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:26.778240 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-64a13431-7894-46ea-92ca-1d63954aa04f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:26.778853 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-64a13431-7894-46ea-92ca-1d63954aa04f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:26.779381 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-64a13431-7894-46ea-92ca-1d63954aa04f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:26.780159 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-64a13431-7894-46ea-92ca-1d63954aa04f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:26.780630 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-64a13431-7894-46ea-92ca-1d63954aa04f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:26.781692 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-64a13431-7894-46ea-92ca-1d63954aa04f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:26.901666 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c9abc39c-17e6-4978-99e8-71935accc35c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:26.908880 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c9abc39c-17e6-4978-99e8-71935accc35c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1725 microversion: 2.1 time: 0.214279 Sep 26 18:11:26.909484 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 429/844] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:26 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:26.965690 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-64a13431-7894-46ea-92ca-1d63954aa04f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:26.976914 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-64a13431-7894-46ea-92ca-1d63954aa04f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:26.976914 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-64a13431-7894-46ea-92ca-1d63954aa04f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:26.978082 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-64a13431-7894-46ea-92ca-1d63954aa04f tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1739 microversion: 2.20 time: 0.212496 Sep 26 18:11:26.978687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 416/845] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:26 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:11:27.933776 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-3edf2c74-b26b-4b57-86a3-5903e4596bb5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:27.934405 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3edf2c74-b26b-4b57-86a3-5903e4596bb5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:27.942041 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3edf2c74-b26b-4b57-86a3-5903e4596bb5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:27.942541 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3edf2c74-b26b-4b57-86a3-5903e4596bb5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:27.942977 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3edf2c74-b26b-4b57-86a3-5903e4596bb5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:27.944002 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3edf2c74-b26b-4b57-86a3-5903e4596bb5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:27.947405 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3edf2c74-b26b-4b57-86a3-5903e4596bb5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:27.947405 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3edf2c74-b26b-4b57-86a3-5903e4596bb5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:28.006061 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-75954682-2113-49dc-b485-b5bc86fb9050 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:28.006917 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-75954682-2113-49dc-b485-b5bc86fb9050 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:28.014322 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75954682-2113-49dc-b485-b5bc86fb9050 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:28.014926 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75954682-2113-49dc-b485-b5bc86fb9050 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:28.015373 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75954682-2113-49dc-b485-b5bc86fb9050 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:28.016599 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75954682-2113-49dc-b485-b5bc86fb9050 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:28.017272 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75954682-2113-49dc-b485-b5bc86fb9050 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:28.017965 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-75954682-2113-49dc-b485-b5bc86fb9050 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:28.196594 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3edf2c74-b26b-4b57-86a3-5903e4596bb5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:28.207502 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-3edf2c74-b26b-4b57-86a3-5903e4596bb5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1702 microversion: 2.1 time: 0.277617 Sep 26 18:11:28.208243 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 430/846] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:27 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1702 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:28.231613 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-70fba315-f6b9-42e3-9727-81ad9e600408 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:11:28.239179 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-70fba315-f6b9-42e3-9727-81ad9e600408 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:28.240077 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-70fba315-f6b9-42e3-9727-81ad9e600408 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:28.240377 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-70fba315-f6b9-42e3-9727-81ad9e600408 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:28.301495 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-75954682-2113-49dc-b485-b5bc86fb9050 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:28.315297 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-75954682-2113-49dc-b485-b5bc86fb9050 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:28.318025 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-75954682-2113-49dc-b485-b5bc86fb9050 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:28.319864 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-75954682-2113-49dc-b485-b5bc86fb9050 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1739 microversion: 2.20 time: 0.317792 Sep 26 18:11:28.329729 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 417/847] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:28 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1739 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:28.337385 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-70fba315-f6b9-42e3-9727-81ad9e600408 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Going to try to start instance {{(pid=121029) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 26 18:11:28.539018 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-70fba315-f6b9-42e3-9727-81ad9e600408 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "POST /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/action" status: 202 len: 0 microversion: 2.1 time: 0.311220 Sep 26 18:11:28.539630 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 431/848] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Sep 26 18:11:28 2022] POST /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 18:11:28.548267 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a326b8c2-079c-4a27-9edb-785c6891f732 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:28.548988 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a326b8c2-079c-4a27-9edb-785c6891f732 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:28.555224 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a326b8c2-079c-4a27-9edb-785c6891f732 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:28.555740 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a326b8c2-079c-4a27-9edb-785c6891f732 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:28.556186 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a326b8c2-079c-4a27-9edb-785c6891f732 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:28.556885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a326b8c2-079c-4a27-9edb-785c6891f732 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:28.557347 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a326b8c2-079c-4a27-9edb-785c6891f732 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:28.557814 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a326b8c2-079c-4a27-9edb-785c6891f732 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:28.698645 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a326b8c2-079c-4a27-9edb-785c6891f732 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:28.707872 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a326b8c2-079c-4a27-9edb-785c6891f732 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1711 microversion: 2.1 time: 0.163527 Sep 26 18:11:28.708443 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 418/849] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:28 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1711 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:29.350666 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-6f5e67e3-9605-4618-8f7d-067836f6f655 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:29.354522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-6f5e67e3-9605-4618-8f7d-067836f6f655 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:29.366000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6f5e67e3-9605-4618-8f7d-067836f6f655 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:29.367297 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6f5e67e3-9605-4618-8f7d-067836f6f655 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:29.368388 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6f5e67e3-9605-4618-8f7d-067836f6f655 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:29.369806 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6f5e67e3-9605-4618-8f7d-067836f6f655 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:29.376545 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6f5e67e3-9605-4618-8f7d-067836f6f655 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:29.376545 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6f5e67e3-9605-4618-8f7d-067836f6f655 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:29.697619 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-6f5e67e3-9605-4618-8f7d-067836f6f655 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:29.709313 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-6f5e67e3-9605-4618-8f7d-067836f6f655 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:29.711160 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-6f5e67e3-9605-4618-8f7d-067836f6f655 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:29.712576 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-6f5e67e3-9605-4618-8f7d-067836f6f655 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1721 microversion: 2.20 time: 0.368844 Sep 26 18:11:29.719200 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 432/850] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:29 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1721 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:29.732584 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-dd82e794-503b-4f74-a357-cbf34e5b7598 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:29.733318 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-dd82e794-503b-4f74-a357-cbf34e5b7598 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:29.740165 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dd82e794-503b-4f74-a357-cbf34e5b7598 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:29.740661 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dd82e794-503b-4f74-a357-cbf34e5b7598 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:29.741097 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dd82e794-503b-4f74-a357-cbf34e5b7598 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:29.741841 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dd82e794-503b-4f74-a357-cbf34e5b7598 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:29.742333 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dd82e794-503b-4f74-a357-cbf34e5b7598 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:29.742758 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dd82e794-503b-4f74-a357-cbf34e5b7598 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:30.127252 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-dd82e794-503b-4f74-a357-cbf34e5b7598 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:30.137368 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-dd82e794-503b-4f74-a357-cbf34e5b7598 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1711 microversion: 2.1 time: 0.408854 Sep 26 18:11:30.137948 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 419/851] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:29 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1711 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:30.743277 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-efb8dad7-9659-4618-a655-6e4e66b08ff1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:30.743873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-efb8dad7-9659-4618-a655-6e4e66b08ff1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:30.750940 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-efb8dad7-9659-4618-a655-6e4e66b08ff1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:30.751411 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-efb8dad7-9659-4618-a655-6e4e66b08ff1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:30.751872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-efb8dad7-9659-4618-a655-6e4e66b08ff1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:30.752560 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-efb8dad7-9659-4618-a655-6e4e66b08ff1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:30.753008 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-efb8dad7-9659-4618-a655-6e4e66b08ff1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:30.753492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-efb8dad7-9659-4618-a655-6e4e66b08ff1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:30.774814 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:30.901665 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-efb8dad7-9659-4618-a655-6e4e66b08ff1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:30.910031 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-efb8dad7-9659-4618-a655-6e4e66b08ff1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:30.911481 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-efb8dad7-9659-4618-a655-6e4e66b08ff1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:30.912671 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-efb8dad7-9659-4618-a655-6e4e66b08ff1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1721 microversion: 2.20 time: 0.175555 Sep 26 18:11:30.913229 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 433/852] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:30 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:31.161427 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e5ad0004-e751-41bc-b5a6-4f940e261847 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:31.162035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e5ad0004-e751-41bc-b5a6-4f940e261847 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:31.168522 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e5ad0004-e751-41bc-b5a6-4f940e261847 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:31.169004 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e5ad0004-e751-41bc-b5a6-4f940e261847 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:31.169435 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e5ad0004-e751-41bc-b5a6-4f940e261847 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:31.170282 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e5ad0004-e751-41bc-b5a6-4f940e261847 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:31.170757 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e5ad0004-e751-41bc-b5a6-4f940e261847 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:31.171163 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e5ad0004-e751-41bc-b5a6-4f940e261847 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:31.336853 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e5ad0004-e751-41bc-b5a6-4f940e261847 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:31.346322 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e5ad0004-e751-41bc-b5a6-4f940e261847 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1711 microversion: 2.1 time: 0.188609 Sep 26 18:11:31.346901 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 420/853] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:31 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1711 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:31.944204 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c7cb3e07-bb70-46e5-935d-9f017ca3f71b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:31.944828 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c7cb3e07-bb70-46e5-935d-9f017ca3f71b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:31.953238 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c7cb3e07-bb70-46e5-935d-9f017ca3f71b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:31.953735 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c7cb3e07-bb70-46e5-935d-9f017ca3f71b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:31.955056 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c7cb3e07-bb70-46e5-935d-9f017ca3f71b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:31.955056 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c7cb3e07-bb70-46e5-935d-9f017ca3f71b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:31.955506 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c7cb3e07-bb70-46e5-935d-9f017ca3f71b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:31.956018 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c7cb3e07-bb70-46e5-935d-9f017ca3f71b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:32.370684 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b606478c-2ab5-47f3-8fb3-5e4fd609112e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:32.371318 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b606478c-2ab5-47f3-8fb3-5e4fd609112e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:32.379190 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b606478c-2ab5-47f3-8fb3-5e4fd609112e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:32.379954 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b606478c-2ab5-47f3-8fb3-5e4fd609112e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:32.380367 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b606478c-2ab5-47f3-8fb3-5e4fd609112e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:32.381059 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b606478c-2ab5-47f3-8fb3-5e4fd609112e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:32.381683 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b606478c-2ab5-47f3-8fb3-5e4fd609112e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:32.382171 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b606478c-2ab5-47f3-8fb3-5e4fd609112e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:32.385285 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=100 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:32.391633 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c7cb3e07-bb70-46e5-935d-9f017ca3f71b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:32.405111 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c7cb3e07-bb70-46e5-935d-9f017ca3f71b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:32.407290 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c7cb3e07-bb70-46e5-935d-9f017ca3f71b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:32.408724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c7cb3e07-bb70-46e5-935d-9f017ca3f71b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1721 microversion: 2.20 time: 0.469155 Sep 26 18:11:32.409569 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 434/854] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:31 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1721 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:32.533797 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b606478c-2ab5-47f3-8fb3-5e4fd609112e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:32.553522 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b606478c-2ab5-47f3-8fb3-5e4fd609112e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1711 microversion: 2.1 time: 0.186866 Sep 26 18:11:32.554271 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 421/855] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:32 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1711 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:11:32.783287 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-d10b9871-ee5b-48d0-9c47-15bde36c7d85 req-bec5cdd8-292e-4c5a-b149-3916d20f6dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157c830f-c695-4a1a-a21f-1d0d6c24dd93", "name": "network-vif-unplugged", "status": "completed", "tag": "4810d7ad-3670-4d57-835a-ea0d6344ef48"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:11:32.799613 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-d10b9871-ee5b-48d0-9c47-15bde36c7d85 req-bec5cdd8-292e-4c5a-b149-3916d20f6dce service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:32.800805 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-d10b9871-ee5b-48d0-9c47-15bde36c7d85 req-bec5cdd8-292e-4c5a-b149-3916d20f6dce service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:32.801483 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-d10b9871-ee5b-48d0-9c47-15bde36c7d85 req-bec5cdd8-292e-4c5a-b149-3916d20f6dce service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:32.822627 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-d10b9871-ee5b-48d0-9c47-15bde36c7d85 req-bec5cdd8-292e-4c5a-b149-3916d20f6dce service nova] Creating event network-vif-unplugged:4810d7ad-3670-4d57-835a-ea0d6344ef48 for instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 on hv-cinder-85931 Sep 26 18:11:32.831684 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-d10b9871-ee5b-48d0-9c47-15bde36c7d85 req-bec5cdd8-292e-4c5a-b149-3916d20f6dce service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052483 Sep 26 18:11:32.832778 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 435/856] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:11:33.434674 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-aaf669b5-a812-4704-a95c-63f59a759fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:33.435375 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-aaf669b5-a812-4704-a95c-63f59a759fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:33.443508 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-aaf669b5-a812-4704-a95c-63f59a759fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:33.444014 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-aaf669b5-a812-4704-a95c-63f59a759fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:33.444448 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-aaf669b5-a812-4704-a95c-63f59a759fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:33.445145 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-aaf669b5-a812-4704-a95c-63f59a759fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:33.445621 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-aaf669b5-a812-4704-a95c-63f59a759fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:33.446031 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-aaf669b5-a812-4704-a95c-63f59a759fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:33.580237 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-258643fa-065f-4027-b690-c2ddc660fe51 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:33.580940 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-258643fa-065f-4027-b690-c2ddc660fe51 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:33.587473 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-258643fa-065f-4027-b690-c2ddc660fe51 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:33.587943 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-258643fa-065f-4027-b690-c2ddc660fe51 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:33.588374 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-258643fa-065f-4027-b690-c2ddc660fe51 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:33.589155 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-258643fa-065f-4027-b690-c2ddc660fe51 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:33.589627 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-258643fa-065f-4027-b690-c2ddc660fe51 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:33.590139 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-258643fa-065f-4027-b690-c2ddc660fe51 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:33.607228 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-aaf669b5-a812-4704-a95c-63f59a759fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:33.616790 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-aaf669b5-a812-4704-a95c-63f59a759fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:33.618397 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-aaf669b5-a812-4704-a95c-63f59a759fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:33.619635 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-aaf669b5-a812-4704-a95c-63f59a759fc1 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1724 microversion: 2.20 time: 0.189069 Sep 26 18:11:33.620217 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 422/857] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:33 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:33.649164 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3d7c1ad4-e763-4f11-b5cd-9a9d8a6e8e27 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "103b37ec-02e4-4e73-9a2a-851b8745c9e4"}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:11:33.651578 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-3d7c1ad4-e763-4f11-b5cd-9a9d8a6e8e27 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:33.657818 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3d7c1ad4-e763-4f11-b5cd-9a9d8a6e8e27 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:33.658304 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3d7c1ad4-e763-4f11-b5cd-9a9d8a6e8e27 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:33.658896 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3d7c1ad4-e763-4f11-b5cd-9a9d8a6e8e27 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:33.659445 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3d7c1ad4-e763-4f11-b5cd-9a9d8a6e8e27 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:33.659992 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3d7c1ad4-e763-4f11-b5cd-9a9d8a6e8e27 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:33.660415 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3d7c1ad4-e763-4f11-b5cd-9a9d8a6e8e27 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:33.749262 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-258643fa-065f-4027-b690-c2ddc660fe51 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:33.758077 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-258643fa-065f-4027-b690-c2ddc660fe51 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1715 microversion: 2.1 time: 0.183644 Sep 26 18:11:33.758647 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 436/858] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:33 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1715 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:34.837138 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-3d7c1ad4-e763-4f11-b5cd-9a9d8a6e8e27 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "POST /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.192218 Sep 26 18:11:34.837771 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 423/859] 10.222.0.67 () {62 vars in 1364 bytes} [Mon Sep 26 18:11:33 2022] POST /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93/os-volume_attachments => generated 188 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 18:11:34.977313 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-120a7dac-b5b8-401a-80f8-655d2eeabc98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:34.977928 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-120a7dac-b5b8-401a-80f8-655d2eeabc98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:34.995984 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-120a7dac-b5b8-401a-80f8-655d2eeabc98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:34.996483 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-120a7dac-b5b8-401a-80f8-655d2eeabc98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:34.997014 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-120a7dac-b5b8-401a-80f8-655d2eeabc98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:34.997805 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-120a7dac-b5b8-401a-80f8-655d2eeabc98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:34.998266 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-120a7dac-b5b8-401a-80f8-655d2eeabc98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:34.998687 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-120a7dac-b5b8-401a-80f8-655d2eeabc98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:35.896068 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-120a7dac-b5b8-401a-80f8-655d2eeabc98 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "DELETE /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93/os-volume_attachments/103b37ec-02e4-4e73-9a2a-851b8745c9e4" status: 202 len: 0 microversion: 2.20 time: 0.925167 Sep 26 18:11:35.897015 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 437/860] 10.222.0.67 () {60 vars in 1457 bytes} [Mon Sep 26 18:11:34 2022] DELETE /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93/os-volume_attachments/103b37ec-02e4-4e73-9a2a-851b8745c9e4 => generated 0 bytes in 928 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:11:35.962738 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ebc2dc53-755b-4b4f-b2fd-bb61021ac127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:11:35.963386 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ebc2dc53-755b-4b4f-b2fd-bb61021ac127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:35.965709 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=56 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:35.971267 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ebc2dc53-755b-4b4f-b2fd-bb61021ac127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:35.971787 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ebc2dc53-755b-4b4f-b2fd-bb61021ac127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:35.972412 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ebc2dc53-755b-4b4f-b2fd-bb61021ac127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:35.973202 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ebc2dc53-755b-4b4f-b2fd-bb61021ac127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:35.973657 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ebc2dc53-755b-4b4f-b2fd-bb61021ac127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:35.974121 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ebc2dc53-755b-4b4f-b2fd-bb61021ac127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:36.006627 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ebc2dc53-755b-4b4f-b2fd-bb61021ac127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121028) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 18:11:36.349742 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ebc2dc53-755b-4b4f-b2fd-bb61021ac127 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "POST /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93/action" status: 202 len: 0 microversion: 2.20 time: 0.391032 Sep 26 18:11:36.350353 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 424/861] 10.222.0.67 () {62 vars in 1319 bytes} [Mon Sep 26 18:11:35 2022] POST /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 26 18:11:36.358570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1423f0d0-ed30-4e9a-890c-f94305152877 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:36.359343 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1423f0d0-ed30-4e9a-890c-f94305152877 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:36.366457 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1423f0d0-ed30-4e9a-890c-f94305152877 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:36.366954 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1423f0d0-ed30-4e9a-890c-f94305152877 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:36.367474 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1423f0d0-ed30-4e9a-890c-f94305152877 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:36.368169 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1423f0d0-ed30-4e9a-890c-f94305152877 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:36.368631 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1423f0d0-ed30-4e9a-890c-f94305152877 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:36.369059 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1423f0d0-ed30-4e9a-890c-f94305152877 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:36.515915 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1423f0d0-ed30-4e9a-890c-f94305152877 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:36.524536 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1423f0d0-ed30-4e9a-890c-f94305152877 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:36.526058 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1423f0d0-ed30-4e9a-890c-f94305152877 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:36.527282 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1423f0d0-ed30-4e9a-890c-f94305152877 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1672 microversion: 2.20 time: 0.172717 Sep 26 18:11:36.527980 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 438/862] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:36 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:37.555825 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a8e0176a-5722-4c24-a02f-be0fdecee961 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:37.556974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a8e0176a-5722-4c24-a02f-be0fdecee961 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:37.574868 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a8e0176a-5722-4c24-a02f-be0fdecee961 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:37.575478 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a8e0176a-5722-4c24-a02f-be0fdecee961 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:37.576255 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a8e0176a-5722-4c24-a02f-be0fdecee961 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:37.577559 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a8e0176a-5722-4c24-a02f-be0fdecee961 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:37.578431 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a8e0176a-5722-4c24-a02f-be0fdecee961 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:37.581751 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a8e0176a-5722-4c24-a02f-be0fdecee961 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:37.775486 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a8e0176a-5722-4c24-a02f-be0fdecee961 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:37.785277 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a8e0176a-5722-4c24-a02f-be0fdecee961 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:37.786849 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a8e0176a-5722-4c24-a02f-be0fdecee961 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:37.788334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a8e0176a-5722-4c24-a02f-be0fdecee961 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1672 microversion: 2.20 time: 0.237484 Sep 26 18:11:37.788933 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 425/863] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:37 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1672 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:38.815108 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5536bd26-ce99-4f68-a389-f0b0f400693b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:38.815745 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-5536bd26-ce99-4f68-a389-f0b0f400693b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:38.822421 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5536bd26-ce99-4f68-a389-f0b0f400693b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:38.822902 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5536bd26-ce99-4f68-a389-f0b0f400693b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:38.823339 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5536bd26-ce99-4f68-a389-f0b0f400693b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:38.824139 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5536bd26-ce99-4f68-a389-f0b0f400693b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:38.824585 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5536bd26-ce99-4f68-a389-f0b0f400693b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:38.825013 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5536bd26-ce99-4f68-a389-f0b0f400693b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:38.970886 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5536bd26-ce99-4f68-a389-f0b0f400693b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:38.977909 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5536bd26-ce99-4f68-a389-f0b0f400693b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:38.979357 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-5536bd26-ce99-4f68-a389-f0b0f400693b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:38.980645 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5536bd26-ce99-4f68-a389-f0b0f400693b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1672 microversion: 2.20 time: 0.170098 Sep 26 18:11:38.981482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 439/864] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:38 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:40.019471 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ce04bef9-d518-440e-8df4-61f02245ae64 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:40.020391 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ce04bef9-d518-440e-8df4-61f02245ae64 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:40.027022 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce04bef9-d518-440e-8df4-61f02245ae64 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:40.027481 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce04bef9-d518-440e-8df4-61f02245ae64 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:40.027946 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce04bef9-d518-440e-8df4-61f02245ae64 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:40.028641 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce04bef9-d518-440e-8df4-61f02245ae64 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:40.029095 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce04bef9-d518-440e-8df4-61f02245ae64 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:40.029539 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce04bef9-d518-440e-8df4-61f02245ae64 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:40.213693 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ce04bef9-d518-440e-8df4-61f02245ae64 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:40.223558 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ce04bef9-d518-440e-8df4-61f02245ae64 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:40.225025 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ce04bef9-d518-440e-8df4-61f02245ae64 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:40.226220 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ce04bef9-d518-440e-8df4-61f02245ae64 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.211454 Sep 26 18:11:40.226783 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 426/865] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:40 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:41.268034 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-86b55f7e-5f72-40a1-95f5-4c21e5a0e1bf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:41.268034 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-86b55f7e-5f72-40a1-95f5-4c21e5a0e1bf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:41.268034 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-86b55f7e-5f72-40a1-95f5-4c21e5a0e1bf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:41.268034 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-86b55f7e-5f72-40a1-95f5-4c21e5a0e1bf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:41.268784 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-86b55f7e-5f72-40a1-95f5-4c21e5a0e1bf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:41.268784 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-86b55f7e-5f72-40a1-95f5-4c21e5a0e1bf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:41.268784 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-86b55f7e-5f72-40a1-95f5-4c21e5a0e1bf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:41.268784 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-86b55f7e-5f72-40a1-95f5-4c21e5a0e1bf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:41.449519 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-86b55f7e-5f72-40a1-95f5-4c21e5a0e1bf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:41.458198 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-86b55f7e-5f72-40a1-95f5-4c21e5a0e1bf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:41.459792 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-86b55f7e-5f72-40a1-95f5-4c21e5a0e1bf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:41.460970 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-86b55f7e-5f72-40a1-95f5-4c21e5a0e1bf tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.212078 Sep 26 18:11:41.461727 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 440/866] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:41 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:42.489965 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-823b4501-d206-4a5b-9962-0a3d86ab9da0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:42.491639 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-823b4501-d206-4a5b-9962-0a3d86ab9da0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:42.503400 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-823b4501-d206-4a5b-9962-0a3d86ab9da0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:42.509292 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-823b4501-d206-4a5b-9962-0a3d86ab9da0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:42.509292 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-823b4501-d206-4a5b-9962-0a3d86ab9da0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:42.509292 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-823b4501-d206-4a5b-9962-0a3d86ab9da0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:42.509292 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-823b4501-d206-4a5b-9962-0a3d86ab9da0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:42.509676 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-823b4501-d206-4a5b-9962-0a3d86ab9da0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:42.675811 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-823b4501-d206-4a5b-9962-0a3d86ab9da0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:42.690203 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-823b4501-d206-4a5b-9962-0a3d86ab9da0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:42.691866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-823b4501-d206-4a5b-9962-0a3d86ab9da0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:42.693644 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-823b4501-d206-4a5b-9962-0a3d86ab9da0 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.209892 Sep 26 18:11:42.694681 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 427/867] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:42 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:43.724154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7cc90e80-f0b8-4676-9955-26b5d519b07b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:43.724920 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7cc90e80-f0b8-4676-9955-26b5d519b07b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:43.737856 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7cc90e80-f0b8-4676-9955-26b5d519b07b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:43.738852 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7cc90e80-f0b8-4676-9955-26b5d519b07b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:43.739876 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7cc90e80-f0b8-4676-9955-26b5d519b07b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:43.741006 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7cc90e80-f0b8-4676-9955-26b5d519b07b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:43.741672 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7cc90e80-f0b8-4676-9955-26b5d519b07b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:43.742339 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7cc90e80-f0b8-4676-9955-26b5d519b07b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:43.922371 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7cc90e80-f0b8-4676-9955-26b5d519b07b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:43.937937 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7cc90e80-f0b8-4676-9955-26b5d519b07b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:43.942501 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7cc90e80-f0b8-4676-9955-26b5d519b07b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:43.944336 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7cc90e80-f0b8-4676-9955-26b5d519b07b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.224126 Sep 26 18:11:43.945359 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 441/868] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:43 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:44.981568 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-968c51bd-081c-40ac-87a9-165170aaf210 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:44.981568 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-968c51bd-081c-40ac-87a9-165170aaf210 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:44.997765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-968c51bd-081c-40ac-87a9-165170aaf210 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:44.998276 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-968c51bd-081c-40ac-87a9-165170aaf210 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:44.998716 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-968c51bd-081c-40ac-87a9-165170aaf210 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:45.022254 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-968c51bd-081c-40ac-87a9-165170aaf210 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:45.022254 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-968c51bd-081c-40ac-87a9-165170aaf210 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:45.022254 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-968c51bd-081c-40ac-87a9-165170aaf210 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:45.231155 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-968c51bd-081c-40ac-87a9-165170aaf210 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:45.240431 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-968c51bd-081c-40ac-87a9-165170aaf210 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:45.241969 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-968c51bd-081c-40ac-87a9-165170aaf210 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:45.243129 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-968c51bd-081c-40ac-87a9-165170aaf210 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.267679 Sep 26 18:11:45.243908 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 428/869] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:44 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:46.272765 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f6018816-a595-480e-9781-e68f0d2e6fe4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:46.273577 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f6018816-a595-480e-9781-e68f0d2e6fe4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:46.282098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f6018816-a595-480e-9781-e68f0d2e6fe4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:46.282599 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f6018816-a595-480e-9781-e68f0d2e6fe4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:46.283041 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f6018816-a595-480e-9781-e68f0d2e6fe4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:46.283801 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f6018816-a595-480e-9781-e68f0d2e6fe4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:46.284267 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f6018816-a595-480e-9781-e68f0d2e6fe4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:46.284702 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f6018816-a595-480e-9781-e68f0d2e6fe4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:46.472734 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f6018816-a595-480e-9781-e68f0d2e6fe4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:46.486395 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f6018816-a595-480e-9781-e68f0d2e6fe4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:46.488077 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f6018816-a595-480e-9781-e68f0d2e6fe4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:46.489296 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f6018816-a595-480e-9781-e68f0d2e6fe4 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.221177 Sep 26 18:11:46.489920 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 442/870] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:46 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:11:47.523279 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b4d39c51-dccd-4fed-9344-057f3e6c5152 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:47.523922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b4d39c51-dccd-4fed-9344-057f3e6c5152 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:47.531842 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4d39c51-dccd-4fed-9344-057f3e6c5152 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:47.532346 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4d39c51-dccd-4fed-9344-057f3e6c5152 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:47.532786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4d39c51-dccd-4fed-9344-057f3e6c5152 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:47.533495 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4d39c51-dccd-4fed-9344-057f3e6c5152 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:47.533992 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4d39c51-dccd-4fed-9344-057f3e6c5152 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:47.534420 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b4d39c51-dccd-4fed-9344-057f3e6c5152 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:47.755683 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b4d39c51-dccd-4fed-9344-057f3e6c5152 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:47.773478 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b4d39c51-dccd-4fed-9344-057f3e6c5152 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:47.775237 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b4d39c51-dccd-4fed-9344-057f3e6c5152 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:47.784924 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b4d39c51-dccd-4fed-9344-057f3e6c5152 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.265575 Sep 26 18:11:47.786142 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 429/871] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:47 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:48.829642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ea25eea5-b1da-4fa7-91fe-19656d8f234c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:48.830482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ea25eea5-b1da-4fa7-91fe-19656d8f234c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:48.832816 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=42 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:48.837792 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ea25eea5-b1da-4fa7-91fe-19656d8f234c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:48.838292 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ea25eea5-b1da-4fa7-91fe-19656d8f234c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:48.838722 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ea25eea5-b1da-4fa7-91fe-19656d8f234c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:48.839423 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ea25eea5-b1da-4fa7-91fe-19656d8f234c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:48.839902 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ea25eea5-b1da-4fa7-91fe-19656d8f234c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:48.840326 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ea25eea5-b1da-4fa7-91fe-19656d8f234c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:49.209324 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ea25eea5-b1da-4fa7-91fe-19656d8f234c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:49.224421 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ea25eea5-b1da-4fa7-91fe-19656d8f234c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:49.226498 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ea25eea5-b1da-4fa7-91fe-19656d8f234c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:49.228408 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ea25eea5-b1da-4fa7-91fe-19656d8f234c tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.404768 Sep 26 18:11:49.229372 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 443/872] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:48 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:50.259375 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3012523c-725c-4a76-806b-4350b39dbe0e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:50.260316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-3012523c-725c-4a76-806b-4350b39dbe0e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:50.268417 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3012523c-725c-4a76-806b-4350b39dbe0e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:50.268979 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3012523c-725c-4a76-806b-4350b39dbe0e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:50.269468 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3012523c-725c-4a76-806b-4350b39dbe0e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:50.270323 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3012523c-725c-4a76-806b-4350b39dbe0e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:50.270901 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3012523c-725c-4a76-806b-4350b39dbe0e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:50.271379 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3012523c-725c-4a76-806b-4350b39dbe0e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:50.463001 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3012523c-725c-4a76-806b-4350b39dbe0e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:50.473274 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3012523c-725c-4a76-806b-4350b39dbe0e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:50.474732 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3012523c-725c-4a76-806b-4350b39dbe0e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:50.475947 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-3012523c-725c-4a76-806b-4350b39dbe0e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.221901 Sep 26 18:11:50.476514 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 430/873] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:50 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:51.507476 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1b2a57d3-da0f-43d4-a76b-9760b7288ce8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:51.515878 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1b2a57d3-da0f-43d4-a76b-9760b7288ce8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:51.522724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b2a57d3-da0f-43d4-a76b-9760b7288ce8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:51.523635 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b2a57d3-da0f-43d4-a76b-9760b7288ce8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:51.524482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b2a57d3-da0f-43d4-a76b-9760b7288ce8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:51.527169 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b2a57d3-da0f-43d4-a76b-9760b7288ce8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:51.527169 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b2a57d3-da0f-43d4-a76b-9760b7288ce8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:51.528273 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1b2a57d3-da0f-43d4-a76b-9760b7288ce8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:51.708186 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1b2a57d3-da0f-43d4-a76b-9760b7288ce8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:51.720427 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1b2a57d3-da0f-43d4-a76b-9760b7288ce8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:51.722029 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1b2a57d3-da0f-43d4-a76b-9760b7288ce8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:51.723226 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1b2a57d3-da0f-43d4-a76b-9760b7288ce8 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.223546 Sep 26 18:11:51.723806 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 444/874] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:51 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:52.757030 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-0f1a06e6-d51d-49e1-8c48-1f0c236366a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:52.757682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-0f1a06e6-d51d-49e1-8c48-1f0c236366a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:52.764738 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0f1a06e6-d51d-49e1-8c48-1f0c236366a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:52.768273 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0f1a06e6-d51d-49e1-8c48-1f0c236366a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:52.768273 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0f1a06e6-d51d-49e1-8c48-1f0c236366a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:52.768273 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0f1a06e6-d51d-49e1-8c48-1f0c236366a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:52.768273 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0f1a06e6-d51d-49e1-8c48-1f0c236366a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:52.768734 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0f1a06e6-d51d-49e1-8c48-1f0c236366a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:52.938620 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-0f1a06e6-d51d-49e1-8c48-1f0c236366a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:52.949882 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-0f1a06e6-d51d-49e1-8c48-1f0c236366a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:52.951993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-0f1a06e6-d51d-49e1-8c48-1f0c236366a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:52.954659 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-0f1a06e6-d51d-49e1-8c48-1f0c236366a7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.201274 Sep 26 18:11:52.955728 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 431/875] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:52 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:53.995711 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bd895278-5de9-4780-9b8a-9563d35b5862 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:53.995711 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-bd895278-5de9-4780-9b8a-9563d35b5862 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:54.003515 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bd895278-5de9-4780-9b8a-9563d35b5862 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:54.004347 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bd895278-5de9-4780-9b8a-9563d35b5862 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:54.004976 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bd895278-5de9-4780-9b8a-9563d35b5862 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:54.006011 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bd895278-5de9-4780-9b8a-9563d35b5862 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:54.006667 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bd895278-5de9-4780-9b8a-9563d35b5862 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:54.007339 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bd895278-5de9-4780-9b8a-9563d35b5862 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:54.232688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bd895278-5de9-4780-9b8a-9563d35b5862 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:54.242972 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bd895278-5de9-4780-9b8a-9563d35b5862 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:54.248481 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bd895278-5de9-4780-9b8a-9563d35b5862 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:54.248481 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bd895278-5de9-4780-9b8a-9563d35b5862 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.258781 Sep 26 18:11:54.248481 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 445/876] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:53 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:54.424922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4a24c723-a680-443f-93f2-8d2909d40fb3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:54.425900 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-22097f42-3b7d-4125-977f-a0d548323aad req-1e52c1e7-aa82-4547-9a7c-b63278107576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19e1622-6521-459d-9db1-80abd4bcf0f8", "tag": "df9e6e2c-d105-4f6a-aaf7-3619c1f5c26c"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:11:54.428787 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4a24c723-a680-443f-93f2-8d2909d40fb3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:54.435119 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-22097f42-3b7d-4125-977f-a0d548323aad req-1e52c1e7-aa82-4547-9a7c-b63278107576 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:54.435606 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-22097f42-3b7d-4125-977f-a0d548323aad req-1e52c1e7-aa82-4547-9a7c-b63278107576 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:54.436083 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-22097f42-3b7d-4125-977f-a0d548323aad req-1e52c1e7-aa82-4547-9a7c-b63278107576 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:54.448667 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4a24c723-a680-443f-93f2-8d2909d40fb3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:54.449553 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4a24c723-a680-443f-93f2-8d2909d40fb3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:54.450330 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4a24c723-a680-443f-93f2-8d2909d40fb3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:54.451606 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4a24c723-a680-443f-93f2-8d2909d40fb3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:54.451749 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-22097f42-3b7d-4125-977f-a0d548323aad req-1e52c1e7-aa82-4547-9a7c-b63278107576 service nova] Creating event network-changed:df9e6e2c-d105-4f6a-aaf7-3619c1f5c26c for instance b19e1622-6521-459d-9db1-80abd4bcf0f8 on hv-cinder-85931 Sep 26 18:11:54.452347 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4a24c723-a680-443f-93f2-8d2909d40fb3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:54.452848 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4a24c723-a680-443f-93f2-8d2909d40fb3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:54.457375 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-22097f42-3b7d-4125-977f-a0d548323aad req-1e52c1e7-aa82-4547-9a7c-b63278107576 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035954 Sep 26 18:11:54.458236 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 446/877] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:11:54.483156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4a24c723-a680-443f-93f2-8d2909d40fb3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Going to try to terminate instance {{(pid=121028) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:11:54.665093 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:54.936411 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4a24c723-a680-443f-93f2-8d2909d40fb3 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 204 len: 0 microversion: 2.1 time: 0.519463 Sep 26 18:11:54.937840 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 432/878] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:11:54 2022] DELETE /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:11:54.954919 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d49a9106-f67d-4b6c-b8e0-43f5c9126104 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:54.957914 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d49a9106-f67d-4b6c-b8e0-43f5c9126104 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:54.971509 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d49a9106-f67d-4b6c-b8e0-43f5c9126104 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:54.972495 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d49a9106-f67d-4b6c-b8e0-43f5c9126104 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:54.973164 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d49a9106-f67d-4b6c-b8e0-43f5c9126104 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:54.974089 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d49a9106-f67d-4b6c-b8e0-43f5c9126104 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:54.985509 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d49a9106-f67d-4b6c-b8e0-43f5c9126104 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:54.986359 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d49a9106-f67d-4b6c-b8e0-43f5c9126104 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:55.205026 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d49a9106-f67d-4b6c-b8e0-43f5c9126104 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:55.216252 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d49a9106-f67d-4b6c-b8e0-43f5c9126104 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1569 microversion: 2.1 time: 0.271102 Sep 26 18:11:55.217220 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 447/879] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:54 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1569 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:11:55.275976 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3a744934-ce1b-4a0d-a783-5dec8c6edc9b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:55.277217 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-3a744934-ce1b-4a0d-a783-5dec8c6edc9b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:55.292776 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3a744934-ce1b-4a0d-a783-5dec8c6edc9b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:55.293726 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3a744934-ce1b-4a0d-a783-5dec8c6edc9b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:55.294491 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3a744934-ce1b-4a0d-a783-5dec8c6edc9b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:55.295725 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3a744934-ce1b-4a0d-a783-5dec8c6edc9b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:55.296584 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3a744934-ce1b-4a0d-a783-5dec8c6edc9b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:55.297354 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3a744934-ce1b-4a0d-a783-5dec8c6edc9b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:55.478110 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3a744934-ce1b-4a0d-a783-5dec8c6edc9b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:55.492271 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3a744934-ce1b-4a0d-a783-5dec8c6edc9b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:55.494954 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3a744934-ce1b-4a0d-a783-5dec8c6edc9b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:55.496617 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-3a744934-ce1b-4a0d-a783-5dec8c6edc9b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.225521 Sep 26 18:11:55.497414 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 433/880] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:55 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:56.244657 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-17ea519a-7716-4cd1-87a0-a862cb581ab2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:56.245258 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-17ea519a-7716-4cd1-87a0-a862cb581ab2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:56.253819 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-17ea519a-7716-4cd1-87a0-a862cb581ab2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:56.254700 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-17ea519a-7716-4cd1-87a0-a862cb581ab2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:56.255446 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-17ea519a-7716-4cd1-87a0-a862cb581ab2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:56.256724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-17ea519a-7716-4cd1-87a0-a862cb581ab2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:56.257543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-17ea519a-7716-4cd1-87a0-a862cb581ab2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:56.258283 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-17ea519a-7716-4cd1-87a0-a862cb581ab2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:56.482294 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-17ea519a-7716-4cd1-87a0-a862cb581ab2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:56.490630 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-17ea519a-7716-4cd1-87a0-a862cb581ab2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1569 microversion: 2.1 time: 0.250818 Sep 26 18:11:56.491223 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 448/881] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:56 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1569 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:11:56.527722 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-faaf6142-9b42-4bdf-8df5-81ac40a9e545 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:56.528717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-faaf6142-9b42-4bdf-8df5-81ac40a9e545 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:56.536346 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-faaf6142-9b42-4bdf-8df5-81ac40a9e545 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:56.536971 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-faaf6142-9b42-4bdf-8df5-81ac40a9e545 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:56.537559 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-faaf6142-9b42-4bdf-8df5-81ac40a9e545 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:56.538447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-faaf6142-9b42-4bdf-8df5-81ac40a9e545 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:56.538964 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-faaf6142-9b42-4bdf-8df5-81ac40a9e545 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:56.539529 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-faaf6142-9b42-4bdf-8df5-81ac40a9e545 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:56.792184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-faaf6142-9b42-4bdf-8df5-81ac40a9e545 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:56.802794 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-faaf6142-9b42-4bdf-8df5-81ac40a9e545 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:56.804292 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-faaf6142-9b42-4bdf-8df5-81ac40a9e545 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:56.805461 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-faaf6142-9b42-4bdf-8df5-81ac40a9e545 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.284427 Sep 26 18:11:56.806018 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 434/882] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:56 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:11:56.911248 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-7bf57206-96ba-4a35-8d89-30dbef1aa598 req-a4c01dcf-3286-4976-8e86-2a0e8c5a4aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157c830f-c695-4a1a-a21f-1d0d6c24dd93", "name": "network-vif-plugged", "status": "completed", "tag": "4810d7ad-3670-4d57-835a-ea0d6344ef48"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:11:56.923195 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-7bf57206-96ba-4a35-8d89-30dbef1aa598 req-a4c01dcf-3286-4976-8e86-2a0e8c5a4aca service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:56.924010 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-7bf57206-96ba-4a35-8d89-30dbef1aa598 req-a4c01dcf-3286-4976-8e86-2a0e8c5a4aca service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:56.925236 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-7bf57206-96ba-4a35-8d89-30dbef1aa598 req-a4c01dcf-3286-4976-8e86-2a0e8c5a4aca service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:56.928117 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:56.940720 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-7bf57206-96ba-4a35-8d89-30dbef1aa598 req-a4c01dcf-3286-4976-8e86-2a0e8c5a4aca service nova] Creating event network-vif-plugged:4810d7ad-3670-4d57-835a-ea0d6344ef48 for instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 on hv-cinder-85931 Sep 26 18:11:56.945602 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-7bf57206-96ba-4a35-8d89-30dbef1aa598 req-a4c01dcf-3286-4976-8e86-2a0e8c5a4aca service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038656 Sep 26 18:11:56.946191 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 449/883] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:11:57.525443 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9060ce9f-ae70-48a8-a19e-e26d186c0fc5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:57.526335 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9060ce9f-ae70-48a8-a19e-e26d186c0fc5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:57.533641 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9060ce9f-ae70-48a8-a19e-e26d186c0fc5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:57.534933 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9060ce9f-ae70-48a8-a19e-e26d186c0fc5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:57.535531 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9060ce9f-ae70-48a8-a19e-e26d186c0fc5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:57.536432 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9060ce9f-ae70-48a8-a19e-e26d186c0fc5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:57.537063 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9060ce9f-ae70-48a8-a19e-e26d186c0fc5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:57.537488 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9060ce9f-ae70-48a8-a19e-e26d186c0fc5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:57.768378 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9060ce9f-ae70-48a8-a19e-e26d186c0fc5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:57.786592 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9060ce9f-ae70-48a8-a19e-e26d186c0fc5 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1450 microversion: 2.1 time: 0.260330 Sep 26 18:11:57.786592 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 435/884] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:57 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1450 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:11:57.841304 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d37f2e89-2bcc-441b-abd6-1bf4d0012206 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:57.843898 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d37f2e89-2bcc-441b-abd6-1bf4d0012206 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:57.851587 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d37f2e89-2bcc-441b-abd6-1bf4d0012206 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:57.852323 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d37f2e89-2bcc-441b-abd6-1bf4d0012206 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:57.852969 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d37f2e89-2bcc-441b-abd6-1bf4d0012206 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:57.854046 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d37f2e89-2bcc-441b-abd6-1bf4d0012206 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:57.854726 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d37f2e89-2bcc-441b-abd6-1bf4d0012206 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:57.855380 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d37f2e89-2bcc-441b-abd6-1bf4d0012206 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:57.859736 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-46473019-3362-4f2a-8876-33b6a2ba294c req-e4683970-8562-4aff-ad74-5c3a2b36602a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19e1622-6521-459d-9db1-80abd4bcf0f8", "name": "network-vif-deleted", "tag": "df9e6e2c-d105-4f6a-aaf7-3619c1f5c26c"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:11:57.876078 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-46473019-3362-4f2a-8876-33b6a2ba294c req-e4683970-8562-4aff-ad74-5c3a2b36602a service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:57.877013 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-46473019-3362-4f2a-8876-33b6a2ba294c req-e4683970-8562-4aff-ad74-5c3a2b36602a service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:57.877663 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-46473019-3362-4f2a-8876-33b6a2ba294c req-e4683970-8562-4aff-ad74-5c3a2b36602a service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:57.906411 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-46473019-3362-4f2a-8876-33b6a2ba294c req-e4683970-8562-4aff-ad74-5c3a2b36602a service nova] Creating event network-vif-deleted:df9e6e2c-d105-4f6a-aaf7-3619c1f5c26c for instance b19e1622-6521-459d-9db1-80abd4bcf0f8 on hv-cinder-85931 Sep 26 18:11:57.915572 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-46473019-3362-4f2a-8876-33b6a2ba294c req-e4683970-8562-4aff-ad74-5c3a2b36602a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075956 Sep 26 18:11:57.916652 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 450/885] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:11:58.069413 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d37f2e89-2bcc-441b-abd6-1bf4d0012206 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:58.081845 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d37f2e89-2bcc-441b-abd6-1bf4d0012206 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:58.084335 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d37f2e89-2bcc-441b-abd6-1bf4d0012206 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:58.086152 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d37f2e89-2bcc-441b-abd6-1bf4d0012206 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.248713 Sep 26 18:11:58.087495 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 436/886] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:57 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:11:58.822943 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-26f8e002-1259-4ede-bd5a-dad72cd612d2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:58.823740 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-26f8e002-1259-4ede-bd5a-dad72cd612d2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:58.831844 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26f8e002-1259-4ede-bd5a-dad72cd612d2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:58.832343 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26f8e002-1259-4ede-bd5a-dad72cd612d2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:58.832783 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26f8e002-1259-4ede-bd5a-dad72cd612d2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:58.833491 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26f8e002-1259-4ede-bd5a-dad72cd612d2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:58.833954 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26f8e002-1259-4ede-bd5a-dad72cd612d2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:58.834386 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26f8e002-1259-4ede-bd5a-dad72cd612d2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:58.917332 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-26f8e002-1259-4ede-bd5a-dad72cd612d2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:58.928582 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-26f8e002-1259-4ede-bd5a-dad72cd612d2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1220 microversion: 2.1 time: 0.110411 Sep 26 18:11:58.929340 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 451/887] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:58 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:11:59.116387 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-953e5f2b-5f1c-4e1c-b326-983a2556e686 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:59.118664 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-953e5f2b-5f1c-4e1c-b326-983a2556e686 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:59.125822 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-953e5f2b-5f1c-4e1c-b326-983a2556e686 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:59.126832 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-953e5f2b-5f1c-4e1c-b326-983a2556e686 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:59.127630 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-953e5f2b-5f1c-4e1c-b326-983a2556e686 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:59.128479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-953e5f2b-5f1c-4e1c-b326-983a2556e686 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:59.129099 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-953e5f2b-5f1c-4e1c-b326-983a2556e686 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:59.129675 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-953e5f2b-5f1c-4e1c-b326-983a2556e686 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:59.347103 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-953e5f2b-5f1c-4e1c-b326-983a2556e686 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:59.359381 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-953e5f2b-5f1c-4e1c-b326-983a2556e686 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:59.361144 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-953e5f2b-5f1c-4e1c-b326-983a2556e686 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:11:59.362530 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-953e5f2b-5f1c-4e1c-b326-983a2556e686 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.253233 Sep 26 18:11:59.363245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 437/888] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:11:59 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:11:59.965757 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-869a0433-5a14-4699-8f9a-8398b47b5f12 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:11:59.967060 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-869a0433-5a14-4699-8f9a-8398b47b5f12 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:11:59.979719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-869a0433-5a14-4699-8f9a-8398b47b5f12 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:59.980601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-869a0433-5a14-4699-8f9a-8398b47b5f12 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:59.981382 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-869a0433-5a14-4699-8f9a-8398b47b5f12 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:11:59.982642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-869a0433-5a14-4699-8f9a-8398b47b5f12 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:11:59.983477 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-869a0433-5a14-4699-8f9a-8398b47b5f12 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:11:59.985124 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-869a0433-5a14-4699-8f9a-8398b47b5f12 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:00.046475 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-869a0433-5a14-4699-8f9a-8398b47b5f12 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:00.048432 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-869a0433-5a14-4699-8f9a-8398b47b5f12 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:00.048552 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-869a0433-5a14-4699-8f9a-8398b47b5f12 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:00.049281 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-869a0433-5a14-4699-8f9a-8398b47b5f12 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lazy-loading 'fault' on Instance uuid b19e1622-6521-459d-9db1-80abd4bcf0f8 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:12:00.117785 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-869a0433-5a14-4699-8f9a-8398b47b5f12 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183fe84502664f49a701a5e9eb4f6cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e4bf78b8f043a598a4b6a1d8acc219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:00.128504 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-869a0433-5a14-4699-8f9a-8398b47b5f12 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 200 len: 1225 microversion: 2.1 time: 0.170206 Sep 26 18:12:00.129091 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 452/889] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:11:59 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 1225 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:00.401215 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-67b00d2e-c024-4dfb-8d89-f1e0c72315d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:00.402444 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-67b00d2e-c024-4dfb-8d89-f1e0c72315d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:00.425114 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-67b00d2e-c024-4dfb-8d89-f1e0c72315d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:00.426992 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-67b00d2e-c024-4dfb-8d89-f1e0c72315d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:00.427990 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-67b00d2e-c024-4dfb-8d89-f1e0c72315d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:00.429498 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-67b00d2e-c024-4dfb-8d89-f1e0c72315d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:00.430634 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-67b00d2e-c024-4dfb-8d89-f1e0c72315d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:00.431405 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-67b00d2e-c024-4dfb-8d89-f1e0c72315d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:00.651713 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-67b00d2e-c024-4dfb-8d89-f1e0c72315d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:00.660823 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-67b00d2e-c024-4dfb-8d89-f1e0c72315d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:00.662251 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-67b00d2e-c024-4dfb-8d89-f1e0c72315d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:00.663786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-67b00d2e-c024-4dfb-8d89-f1e0c72315d6 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1730 microversion: 2.20 time: 0.270510 Sep 26 18:12:00.664549 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 438/890] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:12:00 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1730 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:12:01.158970 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-93ca5964-75f3-4799-8dce-938fdc08d2c2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:01.159954 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-93ca5964-75f3-4799-8dce-938fdc08d2c2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] [instance: b19e1622-6521-459d-9db1-80abd4bcf0f8] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:01.166948 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93ca5964-75f3-4799-8dce-938fdc08d2c2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:01.167456 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93ca5964-75f3-4799-8dce-938fdc08d2c2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:01.167982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93ca5964-75f3-4799-8dce-938fdc08d2c2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:01.168781 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93ca5964-75f3-4799-8dce-938fdc08d2c2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:01.169298 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93ca5964-75f3-4799-8dce-938fdc08d2c2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:01.169729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-93ca5964-75f3-4799-8dce-938fdc08d2c2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:01.185693 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-93ca5964-75f3-4799-8dce-938fdc08d2c2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] HTTP exception thrown: Instance b19e1622-6521-459d-9db1-80abd4bcf0f8 could not be found. Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-93ca5964-75f3-4799-8dce-938fdc08d2c2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Request method failure captured: Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 HTTP/1.1 Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMeonAHBbssns4FrGSCDOHP9p7rMdNHvxYxjMssAAfRdPKU_CpZvJhVimeu5fRavGV2NEn1gZDC2T86X1QeyGR2iRfd9a3AqMzMSXzag3rkcGKBBejd0fTDZ7XOCC1ukzeF5-V3TcKxnDSEIp6JRaJll_cDxQTB3gM2GaCGNn2DRyWGc Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: 08e4bf78b8f043a598a4b6a1d8acc219 Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-TestShelveInstance-878177301 Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:12:01.188101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:12:01.190782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/08e4bf78b8f043a598a4b6a1d8acc219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/08e4bf78b8f043a598a4b6a1d8acc219"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_08e4bf78b8f043a598a4b6a1d8acc219"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/08e4bf78b8f043a598a4b6a1d8acc219"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:12:01.190782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-TestShelveInstance-878177301 Sep 26 18:12:01.190782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: 08e4bf78b8f043a598a4b6a1d8acc219 Sep 26 18:12:01.190782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-TestShelveInstance-878177301 Sep 26 18:12:01.190782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-TestShelveInstance-878177301-project Sep 26 18:12:01.190782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:12:01.190782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:12:01.190782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 183fe84502664f49a701a5e9eb4f6cd7 Sep 26 18:12:01.190782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-TestShelveInstance-878177301-project Sep 26 18:12:01.190782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:12:01.190782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance b19e1622-6521-459d-9db1-80abd4bcf0f8 could not be found. Sep 26 18:12:01.190782 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': 'b19e1622-6521-459d-9db1-80abd4bcf0f8'} Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19e1622-6521-459d-9db1-80abd4bcf0f8 could not be found. Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:12:01.192492 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19e1622-6521-459d-9db1-80abd4bcf0f8 could not be found. Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19e1622-6521-459d-9db1-80abd4bcf0f8 could not be found. Sep 26 18:12:01.195463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:01.197661 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-93ca5964-75f3-4799-8dce-938fdc08d2c2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Returning 404 to user: Instance b19e1622-6521-459d-9db1-80abd4bcf0f8 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:12:01.197661 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-93ca5964-75f3-4799-8dce-938fdc08d2c2 tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8" status: 404 len: 111 microversion: 2.1 time: 0.036907 Sep 26 18:12:01.197661 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 453/891] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:01 2022] GET /compute/v2.1/servers/b19e1622-6521-459d-9db1-80abd4bcf0f8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:12:01.484632 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2cb65104-0a69-43fe-8234-2f1a55ac25ef tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] Calling method '.version_select at 0x7f3a74b0c040>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:01.601118 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2cb65104-0a69-43fe-8234-2f1a55ac25ef tempest-TestShelveInstance-878177301 tempest-TestShelveInstance-878177301-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1527584654" status: 202 len: 0 microversion: 2.1 time: 0.120750 Sep 26 18:12:01.602207 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 439/892] 10.222.0.67 () {58 vars in 1254 bytes} [Mon Sep 26 18:12:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1527584654 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:12:01.699048 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7dbf8893-a202-4d94-889f-9db92edb9621 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:01.700041 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7dbf8893-a202-4d94-889f-9db92edb9621 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:01.707826 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7dbf8893-a202-4d94-889f-9db92edb9621 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:01.709117 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7dbf8893-a202-4d94-889f-9db92edb9621 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:01.709546 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7dbf8893-a202-4d94-889f-9db92edb9621 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:01.710545 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7dbf8893-a202-4d94-889f-9db92edb9621 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:01.711479 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7dbf8893-a202-4d94-889f-9db92edb9621 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:01.712114 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7dbf8893-a202-4d94-889f-9db92edb9621 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:01.973328 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7dbf8893-a202-4d94-889f-9db92edb9621 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:01.996911 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7dbf8893-a202-4d94-889f-9db92edb9621 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:01.998356 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7dbf8893-a202-4d94-889f-9db92edb9621 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:02.000210 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7dbf8893-a202-4d94-889f-9db92edb9621 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1717 microversion: 2.20 time: 0.305251 Sep 26 18:12:02.000765 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 454/893] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:12:01 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1717 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:12:03.596529 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-356611101", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452", "networks": [{"uuid": "3c66d0c1-a26e-44a7-90d6-75ca678825c7"}]}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:12:03.694671 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.network.neutron [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] validate_networks() for [('3c66d0c1-a26e-44a7-90d6-75ca678825c7', None, None, None, None, None)] {{(pid=121028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:12:04.607468 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Flavor limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:12:04.608080 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Image limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:12:04.608374 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Flavor pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:12:04.608953 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Image pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:12:04.609360 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:12:04.619032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:04.619520 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:04.620014 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:04.620748 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:04.621213 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:04.621642 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:04.645039 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Getting quotas for project 518090209d9a462fbf40d6cb86c3c695. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:12:04.658727 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Getting quotas for user ecf12b3f54e349d5a8f6587410c79501 and project 518090209d9a462fbf40d6cb86c3c695. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:12:04.680715 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Going to run 1 instances... {{(pid=121028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:12:04.685654 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:12:04.799554 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ca0e2743-d164-4643-a9c9-414350e3672b tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.209577 Sep 26 18:12:04.811055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 440/894] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:12:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:12:04.820677 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c7a17f74-0076-4ff9-bf56-f8ea3f888c23 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:04.822330 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c7a17f74-0076-4ff9-bf56-f8ea3f888c23 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:04.933371 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c7a17f74-0076-4ff9-bf56-f8ea3f888c23 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:04.948392 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c7a17f74-0076-4ff9-bf56-f8ea3f888c23 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1218 microversion: 2.1 time: 0.132764 Sep 26 18:12:04.948971 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 455/895] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:04 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:05.975133 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f9e687e9-6335-44e5-9c76-69d8617996da tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:05.976846 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f9e687e9-6335-44e5-9c76-69d8617996da tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:06.065429 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f9e687e9-6335-44e5-9c76-69d8617996da tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:06.074464 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f9e687e9-6335-44e5-9c76-69d8617996da tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1218 microversion: 2.1 time: 0.103780 Sep 26 18:12:06.075211 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 441/896] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:05 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:07.098642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1c6eabe9-2d3b-42db-ab6c-70314d2f7ccf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:07.099274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1c6eabe9-2d3b-42db-ab6c-70314d2f7ccf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:07.109449 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1c6eabe9-2d3b-42db-ab6c-70314d2f7ccf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:07.110026 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1c6eabe9-2d3b-42db-ab6c-70314d2f7ccf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:07.110687 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1c6eabe9-2d3b-42db-ab6c-70314d2f7ccf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:07.111413 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1c6eabe9-2d3b-42db-ab6c-70314d2f7ccf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:07.111986 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1c6eabe9-2d3b-42db-ab6c-70314d2f7ccf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:07.112438 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1c6eabe9-2d3b-42db-ab6c-70314d2f7ccf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:07.188724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1c6eabe9-2d3b-42db-ab6c-70314d2f7ccf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:07.196996 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1c6eabe9-2d3b-42db-ab6c-70314d2f7ccf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1270 microversion: 2.1 time: 0.102645 Sep 26 18:12:07.197613 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 456/897] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:07 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1270 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:08.228391 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9305bf78-f4f5-4446-8df0-b3022b3c16dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:08.229579 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9305bf78-f4f5-4446-8df0-b3022b3c16dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:08.234224 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:08.239723 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9305bf78-f4f5-4446-8df0-b3022b3c16dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:08.244147 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9305bf78-f4f5-4446-8df0-b3022b3c16dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:08.244147 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9305bf78-f4f5-4446-8df0-b3022b3c16dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:08.244147 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9305bf78-f4f5-4446-8df0-b3022b3c16dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:08.244147 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9305bf78-f4f5-4446-8df0-b3022b3c16dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:08.244501 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9305bf78-f4f5-4446-8df0-b3022b3c16dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:08.351602 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9305bf78-f4f5-4446-8df0-b3022b3c16dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:08.360783 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9305bf78-f4f5-4446-8df0-b3022b3c16dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1276 microversion: 2.1 time: 0.138954 Sep 26 18:12:08.361367 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 442/898] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:08 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:09.400905 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8a8904d5-9a0a-4155-9461-99838a6ce86a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:09.401683 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-8a8904d5-9a0a-4155-9461-99838a6ce86a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:09.409737 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8a8904d5-9a0a-4155-9461-99838a6ce86a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:09.410368 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8a8904d5-9a0a-4155-9461-99838a6ce86a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:09.410988 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8a8904d5-9a0a-4155-9461-99838a6ce86a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:09.411803 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8a8904d5-9a0a-4155-9461-99838a6ce86a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:09.412458 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8a8904d5-9a0a-4155-9461-99838a6ce86a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:09.413127 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8a8904d5-9a0a-4155-9461-99838a6ce86a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:09.728763 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-8a8904d5-9a0a-4155-9461-99838a6ce86a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:09.739042 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-8a8904d5-9a0a-4155-9461-99838a6ce86a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1318 microversion: 2.1 time: 0.341850 Sep 26 18:12:09.740119 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 457/899] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:09 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:10.309578 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-97cd6deb-ddff-433b-a6a3-789482c1cb6c req-6055e67f-5422-4a6f-8fe4-fbab431ddc84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc", "tag": "7a1efa53-2b1f-44fd-9dd7-f4d10ce00d81"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:12:10.331790 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-97cd6deb-ddff-433b-a6a3-789482c1cb6c req-6055e67f-5422-4a6f-8fe4-fbab431ddc84 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:10.332779 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-97cd6deb-ddff-433b-a6a3-789482c1cb6c req-6055e67f-5422-4a6f-8fe4-fbab431ddc84 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:10.333697 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-97cd6deb-ddff-433b-a6a3-789482c1cb6c req-6055e67f-5422-4a6f-8fe4-fbab431ddc84 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:10.349140 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-97cd6deb-ddff-433b-a6a3-789482c1cb6c req-6055e67f-5422-4a6f-8fe4-fbab431ddc84 service nova] Creating event network-changed:7a1efa53-2b1f-44fd-9dd7-f4d10ce00d81 for instance 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc on hv-cinder-85931 Sep 26 18:12:10.355405 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-97cd6deb-ddff-433b-a6a3-789482c1cb6c req-6055e67f-5422-4a6f-8fe4-fbab431ddc84 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053433 Sep 26 18:12:10.356236 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 443/900] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:12:10.776570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1583e3c3-fceb-4586-891e-ab12ed75b9e0 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:10.791131 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1583e3c3-fceb-4586-891e-ab12ed75b9e0 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:10.807179 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1583e3c3-fceb-4586-891e-ab12ed75b9e0 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:10.807179 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1583e3c3-fceb-4586-891e-ab12ed75b9e0 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:10.808844 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1583e3c3-fceb-4586-891e-ab12ed75b9e0 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:10.810172 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1583e3c3-fceb-4586-891e-ab12ed75b9e0 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:10.812826 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1583e3c3-fceb-4586-891e-ab12ed75b9e0 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:10.813543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1583e3c3-fceb-4586-891e-ab12ed75b9e0 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:11.087402 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1583e3c3-fceb-4586-891e-ab12ed75b9e0 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:11.102043 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1583e3c3-fceb-4586-891e-ab12ed75b9e0 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1318 microversion: 2.1 time: 0.338707 Sep 26 18:12:11.103021 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 458/901] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:10 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:12.029824 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1fae7bfc-8f9b-4983-8c27-96b0a4dff0b1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:12.030513 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1fae7bfc-8f9b-4983-8c27-96b0a4dff0b1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:12.037350 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1fae7bfc-8f9b-4983-8c27-96b0a4dff0b1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:12.037836 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1fae7bfc-8f9b-4983-8c27-96b0a4dff0b1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:12.038272 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1fae7bfc-8f9b-4983-8c27-96b0a4dff0b1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:12.038970 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1fae7bfc-8f9b-4983-8c27-96b0a4dff0b1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:12.039428 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1fae7bfc-8f9b-4983-8c27-96b0a4dff0b1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:12.039914 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1fae7bfc-8f9b-4983-8c27-96b0a4dff0b1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:12.130642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-db58c25b-9a5b-4e1b-af83-1e5a58407896 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:12.130642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-db58c25b-9a5b-4e1b-af83-1e5a58407896 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:12.142680 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-db58c25b-9a5b-4e1b-af83-1e5a58407896 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:12.149464 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-db58c25b-9a5b-4e1b-af83-1e5a58407896 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:12.149464 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-db58c25b-9a5b-4e1b-af83-1e5a58407896 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:12.149464 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-db58c25b-9a5b-4e1b-af83-1e5a58407896 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:12.149464 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-db58c25b-9a5b-4e1b-af83-1e5a58407896 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:12.150639 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-db58c25b-9a5b-4e1b-af83-1e5a58407896 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:12.153116 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-1fae7bfc-8f9b-4983-8c27-96b0a4dff0b1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lazy-loading 'services' on Instance uuid 7369614f-dc83-49a8-b16c-2c2189b1e9db {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:12:12.314088 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1fae7bfc-8f9b-4983-8c27-96b0a4dff0b1 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/os-volume_attachments/695d61e9-ef80-40bf-aff1-7df09880f2d3" status: 202 len: 0 microversion: 2.1 time: 0.288949 Sep 26 18:12:12.314767 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 444/902] 10.222.0.67 () {58 vars in 1416 bytes} [Mon Sep 26 18:12:12 2022] DELETE /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/os-volume_attachments/695d61e9-ef80-40bf-aff1-7df09880f2d3 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:12:12.315203 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-db58c25b-9a5b-4e1b-af83-1e5a58407896 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:12.336894 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-db58c25b-9a5b-4e1b-af83-1e5a58407896 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1318 microversion: 2.1 time: 0.210728 Sep 26 18:12:12.337484 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 459/903] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:12 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:12:13.370196 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-21e991d6-2903-44db-b05c-ecaa27306dba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:13.371303 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-21e991d6-2903-44db-b05c-ecaa27306dba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:13.381402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-21e991d6-2903-44db-b05c-ecaa27306dba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:13.382294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-21e991d6-2903-44db-b05c-ecaa27306dba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:13.388749 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-21e991d6-2903-44db-b05c-ecaa27306dba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:13.388749 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-21e991d6-2903-44db-b05c-ecaa27306dba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:13.388749 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-21e991d6-2903-44db-b05c-ecaa27306dba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:13.388749 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-21e991d6-2903-44db-b05c-ecaa27306dba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:13.580309 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-21e991d6-2903-44db-b05c-ecaa27306dba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:13.594173 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-21e991d6-2903-44db-b05c-ecaa27306dba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1318 microversion: 2.1 time: 0.229089 Sep 26 18:12:13.595270 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 445/904] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:13 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:14.564474 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-95a2b6a4-f868-4d0e-821b-049416182750 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:12:14.573734 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95a2b6a4-f868-4d0e-821b-049416182750 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:14.574236 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95a2b6a4-f868-4d0e-821b-049416182750 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:14.574676 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95a2b6a4-f868-4d0e-821b-049416182750 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:14.605647 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-95a2b6a4-f868-4d0e-821b-049416182750 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Going to try to stop instance {{(pid=121029) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 26 18:12:14.627089 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f615ed93-b360-4855-8381-1b5fd359faa5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:14.628176 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f615ed93-b360-4855-8381-1b5fd359faa5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:14.632025 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=2 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:14.640927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f615ed93-b360-4855-8381-1b5fd359faa5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:14.641759 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f615ed93-b360-4855-8381-1b5fd359faa5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:14.644441 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f615ed93-b360-4855-8381-1b5fd359faa5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:14.644441 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f615ed93-b360-4855-8381-1b5fd359faa5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:14.644787 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f615ed93-b360-4855-8381-1b5fd359faa5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:14.645602 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f615ed93-b360-4855-8381-1b5fd359faa5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:14.808280 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f615ed93-b360-4855-8381-1b5fd359faa5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:14.818413 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-95a2b6a4-f868-4d0e-821b-049416182750 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "POST /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/action" status: 202 len: 0 microversion: 2.1 time: 0.258565 Sep 26 18:12:14.819132 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 460/905] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Sep 26 18:12:14 2022] POST /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:12:14.819548 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f615ed93-b360-4855-8381-1b5fd359faa5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1318 microversion: 2.1 time: 0.199942 Sep 26 18:12:14.820443 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 446/906] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:14 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:14.828726 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-0036c752-0754-4597-864a-131cc34e5fd6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:14.829451 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-0036c752-0754-4597-864a-131cc34e5fd6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:14.836553 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0036c752-0754-4597-864a-131cc34e5fd6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:14.837058 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0036c752-0754-4597-864a-131cc34e5fd6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:14.837503 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0036c752-0754-4597-864a-131cc34e5fd6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:14.838230 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0036c752-0754-4597-864a-131cc34e5fd6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:14.838692 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0036c752-0754-4597-864a-131cc34e5fd6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:14.839128 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0036c752-0754-4597-864a-131cc34e5fd6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:14.947123 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:15.034918 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-0036c752-0754-4597-864a-131cc34e5fd6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:15.043039 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-0036c752-0754-4597-864a-131cc34e5fd6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1679 microversion: 2.1 time: 0.219172 Sep 26 18:12:15.043631 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 461/907] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:14 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1679 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:12:15.850673 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a5c7b5ea-4481-40a8-95d5-407f61f95513 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:15.851680 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a5c7b5ea-4481-40a8-95d5-407f61f95513 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:15.862528 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a5c7b5ea-4481-40a8-95d5-407f61f95513 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:15.863406 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a5c7b5ea-4481-40a8-95d5-407f61f95513 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:15.864238 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a5c7b5ea-4481-40a8-95d5-407f61f95513 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:15.865515 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a5c7b5ea-4481-40a8-95d5-407f61f95513 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:15.866128 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a5c7b5ea-4481-40a8-95d5-407f61f95513 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:15.866875 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a5c7b5ea-4481-40a8-95d5-407f61f95513 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:16.052123 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a5c7b5ea-4481-40a8-95d5-407f61f95513 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:16.063282 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a5c7b5ea-4481-40a8-95d5-407f61f95513 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1318 microversion: 2.1 time: 0.220332 Sep 26 18:12:16.063946 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 447/908] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:15 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:16.071507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f14bb0d1-4a67-4610-8c56-fb2ecb29be9b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:16.073987 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f14bb0d1-4a67-4610-8c56-fb2ecb29be9b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:16.086504 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f14bb0d1-4a67-4610-8c56-fb2ecb29be9b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:16.087036 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f14bb0d1-4a67-4610-8c56-fb2ecb29be9b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:16.087566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f14bb0d1-4a67-4610-8c56-fb2ecb29be9b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:16.088396 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f14bb0d1-4a67-4610-8c56-fb2ecb29be9b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:16.088868 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f14bb0d1-4a67-4610-8c56-fb2ecb29be9b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:16.089544 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f14bb0d1-4a67-4610-8c56-fb2ecb29be9b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:16.295750 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f14bb0d1-4a67-4610-8c56-fb2ecb29be9b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:16.304829 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f14bb0d1-4a67-4610-8c56-fb2ecb29be9b tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1679 microversion: 2.1 time: 0.240505 Sep 26 18:12:16.305461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 462/909] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:16 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1679 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:12:17.095032 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9431c289-8a5b-4eab-b80d-ed302e2aaadf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:17.095938 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9431c289-8a5b-4eab-b80d-ed302e2aaadf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:17.098555 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=8 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:17.106735 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9431c289-8a5b-4eab-b80d-ed302e2aaadf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:17.107552 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9431c289-8a5b-4eab-b80d-ed302e2aaadf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:17.109108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9431c289-8a5b-4eab-b80d-ed302e2aaadf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:17.110219 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9431c289-8a5b-4eab-b80d-ed302e2aaadf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:17.110770 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9431c289-8a5b-4eab-b80d-ed302e2aaadf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:17.111231 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9431c289-8a5b-4eab-b80d-ed302e2aaadf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:17.162799 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-8564f7ea-5059-4e87-bab0-cf2ad9115660 req-845e29ac-dc08-4d0d-b0a5-d890c1800ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc", "name": "network-vif-plugged", "status": "completed", "tag": "7a1efa53-2b1f-44fd-9dd7-f4d10ce00d81"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:12:17.175883 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-8564f7ea-5059-4e87-bab0-cf2ad9115660 req-845e29ac-dc08-4d0d-b0a5-d890c1800ab1 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:17.176491 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-8564f7ea-5059-4e87-bab0-cf2ad9115660 req-845e29ac-dc08-4d0d-b0a5-d890c1800ab1 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:17.176938 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-8564f7ea-5059-4e87-bab0-cf2ad9115660 req-845e29ac-dc08-4d0d-b0a5-d890c1800ab1 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:17.191313 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-8564f7ea-5059-4e87-bab0-cf2ad9115660 req-845e29ac-dc08-4d0d-b0a5-d890c1800ab1 service nova] Creating event network-vif-plugged:7a1efa53-2b1f-44fd-9dd7-f4d10ce00d81 for instance 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc on hv-cinder-85931 Sep 26 18:12:17.198654 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-8564f7ea-5059-4e87-bab0-cf2ad9115660 req-845e29ac-dc08-4d0d-b0a5-d890c1800ab1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044752 Sep 26 18:12:17.199381 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 463/910] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:12:17.275270 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9431c289-8a5b-4eab-b80d-ed302e2aaadf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:17.285005 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9431c289-8a5b-4eab-b80d-ed302e2aaadf tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1318 microversion: 2.1 time: 0.197062 Sep 26 18:12:17.285797 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 448/911] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:17 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:17.331816 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-36715045-8c3b-4841-9ff4-349689fcff49 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:17.332535 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-36715045-8c3b-4841-9ff4-349689fcff49 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:17.339233 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-36715045-8c3b-4841-9ff4-349689fcff49 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:17.339803 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-36715045-8c3b-4841-9ff4-349689fcff49 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:17.340253 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-36715045-8c3b-4841-9ff4-349689fcff49 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:17.340966 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-36715045-8c3b-4841-9ff4-349689fcff49 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:17.341434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-36715045-8c3b-4841-9ff4-349689fcff49 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:17.341897 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-36715045-8c3b-4841-9ff4-349689fcff49 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:17.494183 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-36715045-8c3b-4841-9ff4-349689fcff49 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:17.502100 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-36715045-8c3b-4841-9ff4-349689fcff49 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1679 microversion: 2.1 time: 0.175502 Sep 26 18:12:17.502674 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 464/912] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:17 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:12:18.308721 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-7511eef6-c8a9-4b53-b9e6-2f56a39fb457 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:18.309343 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-7511eef6-c8a9-4b53-b9e6-2f56a39fb457 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:18.316922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7511eef6-c8a9-4b53-b9e6-2f56a39fb457 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:18.319337 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7511eef6-c8a9-4b53-b9e6-2f56a39fb457 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:18.319337 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7511eef6-c8a9-4b53-b9e6-2f56a39fb457 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:18.319337 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7511eef6-c8a9-4b53-b9e6-2f56a39fb457 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:18.319337 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7511eef6-c8a9-4b53-b9e6-2f56a39fb457 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:18.319787 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7511eef6-c8a9-4b53-b9e6-2f56a39fb457 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:18.474789 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-7511eef6-c8a9-4b53-b9e6-2f56a39fb457 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:18.484664 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-7511eef6-c8a9-4b53-b9e6-2f56a39fb457 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1318 microversion: 2.1 time: 0.179589 Sep 26 18:12:18.487890 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 449/913] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:18 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:18.526545 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9397534a-3e55-49ad-b7bb-bcee58d27768 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:18.527242 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9397534a-3e55-49ad-b7bb-bcee58d27768 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:18.534814 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9397534a-3e55-49ad-b7bb-bcee58d27768 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:18.535357 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9397534a-3e55-49ad-b7bb-bcee58d27768 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:18.535917 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9397534a-3e55-49ad-b7bb-bcee58d27768 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:18.536860 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9397534a-3e55-49ad-b7bb-bcee58d27768 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:18.537367 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9397534a-3e55-49ad-b7bb-bcee58d27768 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:18.537865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9397534a-3e55-49ad-b7bb-bcee58d27768 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:18.694035 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9397534a-3e55-49ad-b7bb-bcee58d27768 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:18.702255 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9397534a-3e55-49ad-b7bb-bcee58d27768 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1679 microversion: 2.1 time: 0.179679 Sep 26 18:12:18.702841 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 465/914] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:18 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:19.508846 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d1599e57-0241-4383-8514-03855b17218c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:19.510606 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d1599e57-0241-4383-8514-03855b17218c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:19.518217 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d1599e57-0241-4383-8514-03855b17218c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:19.518966 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d1599e57-0241-4383-8514-03855b17218c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:19.519403 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d1599e57-0241-4383-8514-03855b17218c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:19.520154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d1599e57-0241-4383-8514-03855b17218c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:19.520686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d1599e57-0241-4383-8514-03855b17218c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:19.521121 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d1599e57-0241-4383-8514-03855b17218c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:19.697491 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d1599e57-0241-4383-8514-03855b17218c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:19.707170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d1599e57-0241-4383-8514-03855b17218c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1508 microversion: 2.1 time: 0.202154 Sep 26 18:12:19.707782 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 450/915] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:19 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:19.726502 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-87560acb-62ae-46f4-b158-dc84bc968987 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:19.727600 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-87560acb-62ae-46f4-b158-dc84bc968987 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:19.729747 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=50 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:19.735520 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-87560acb-62ae-46f4-b158-dc84bc968987 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:19.736050 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-87560acb-62ae-46f4-b158-dc84bc968987 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:19.736625 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-87560acb-62ae-46f4-b158-dc84bc968987 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:19.740508 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-87560acb-62ae-46f4-b158-dc84bc968987 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:19.740508 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-87560acb-62ae-46f4-b158-dc84bc968987 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:19.740508 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-87560acb-62ae-46f4-b158-dc84bc968987 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:19.924616 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-87560acb-62ae-46f4-b158-dc84bc968987 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:19.933518 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-87560acb-62ae-46f4-b158-dc84bc968987 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1679 microversion: 2.1 time: 0.210924 Sep 26 18:12:19.934104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 466/916] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:19 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1679 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:20.958798 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a782597f-e7f9-4869-aa34-b7236677aa05 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:20.959388 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a782597f-e7f9-4869-aa34-b7236677aa05 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:20.966095 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a782597f-e7f9-4869-aa34-b7236677aa05 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:20.966585 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a782597f-e7f9-4869-aa34-b7236677aa05 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:20.967037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a782597f-e7f9-4869-aa34-b7236677aa05 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:20.971556 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a782597f-e7f9-4869-aa34-b7236677aa05 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:20.971556 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a782597f-e7f9-4869-aa34-b7236677aa05 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:20.971556 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a782597f-e7f9-4869-aa34-b7236677aa05 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:21.247766 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a782597f-e7f9-4869-aa34-b7236677aa05 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:21.251399 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:21.260816 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a782597f-e7f9-4869-aa34-b7236677aa05 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1679 microversion: 2.1 time: 0.305812 Sep 26 18:12:21.261738 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 451/917] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:20 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1679 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:22.290979 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d1596813-1ce1-4067-b8c4-0786ec836ee7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:22.291574 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d1596813-1ce1-4067-b8c4-0786ec836ee7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:22.299604 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d1596813-1ce1-4067-b8c4-0786ec836ee7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:22.300121 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d1596813-1ce1-4067-b8c4-0786ec836ee7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:22.300567 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d1596813-1ce1-4067-b8c4-0786ec836ee7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:22.301288 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d1596813-1ce1-4067-b8c4-0786ec836ee7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:22.301753 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d1596813-1ce1-4067-b8c4-0786ec836ee7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:22.302177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d1596813-1ce1-4067-b8c4-0786ec836ee7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:22.459340 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d1596813-1ce1-4067-b8c4-0786ec836ee7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:22.473935 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d1596813-1ce1-4067-b8c4-0786ec836ee7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1679 microversion: 2.1 time: 0.186574 Sep 26 18:12:22.474998 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 467/918] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:22 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1679 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:23.500111 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9b12c409-b37a-4dda-87bd-3f9c652b737a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:23.500732 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9b12c409-b37a-4dda-87bd-3f9c652b737a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:23.508235 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9b12c409-b37a-4dda-87bd-3f9c652b737a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:23.509419 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9b12c409-b37a-4dda-87bd-3f9c652b737a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:23.509419 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9b12c409-b37a-4dda-87bd-3f9c652b737a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:23.509848 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9b12c409-b37a-4dda-87bd-3f9c652b737a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:23.510291 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9b12c409-b37a-4dda-87bd-3f9c652b737a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:23.510716 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9b12c409-b37a-4dda-87bd-3f9c652b737a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:23.687626 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9b12c409-b37a-4dda-87bd-3f9c652b737a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:23.699436 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9b12c409-b37a-4dda-87bd-3f9c652b737a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1679 microversion: 2.1 time: 0.203778 Sep 26 18:12:23.700452 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 452/919] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:23 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1679 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:24.723083 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f71f4bf4-d84c-41e1-860d-3a450f7a3d5c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:24.723723 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f71f4bf4-d84c-41e1-860d-3a450f7a3d5c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:24.730654 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f71f4bf4-d84c-41e1-860d-3a450f7a3d5c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:24.731154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f71f4bf4-d84c-41e1-860d-3a450f7a3d5c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:24.731598 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f71f4bf4-d84c-41e1-860d-3a450f7a3d5c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:24.732380 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f71f4bf4-d84c-41e1-860d-3a450f7a3d5c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:24.732851 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f71f4bf4-d84c-41e1-860d-3a450f7a3d5c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:24.733407 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f71f4bf4-d84c-41e1-860d-3a450f7a3d5c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:24.737268 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:24.879375 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f71f4bf4-d84c-41e1-860d-3a450f7a3d5c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:24.887334 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f71f4bf4-d84c-41e1-860d-3a450f7a3d5c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1679 microversion: 2.1 time: 0.168111 Sep 26 18:12:24.887888 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 468/920] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:24 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:25.911855 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-de482650-0f3f-4010-9bb7-7e1bff0f338c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:25.912523 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-de482650-0f3f-4010-9bb7-7e1bff0f338c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:25.920273 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de482650-0f3f-4010-9bb7-7e1bff0f338c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:25.920814 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de482650-0f3f-4010-9bb7-7e1bff0f338c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:25.921536 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de482650-0f3f-4010-9bb7-7e1bff0f338c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:25.922271 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de482650-0f3f-4010-9bb7-7e1bff0f338c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:25.922727 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de482650-0f3f-4010-9bb7-7e1bff0f338c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:25.923149 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de482650-0f3f-4010-9bb7-7e1bff0f338c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:26.064735 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-de482650-0f3f-4010-9bb7-7e1bff0f338c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:26.073111 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-de482650-0f3f-4010-9bb7-7e1bff0f338c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1656 microversion: 2.1 time: 0.165351 Sep 26 18:12:26.073701 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 453/921] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:25 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1656 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:26.097975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9f763a62-8ad5-4f44-9ca4-b1ba2235fb74 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:12:26.105335 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9f763a62-8ad5-4f44-9ca4-b1ba2235fb74 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:26.105834 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9f763a62-8ad5-4f44-9ca4-b1ba2235fb74 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:26.106278 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9f763a62-8ad5-4f44-9ca4-b1ba2235fb74 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:26.131821 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9f763a62-8ad5-4f44-9ca4-b1ba2235fb74 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Going to try to start instance {{(pid=121029) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 26 18:12:26.396522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9f763a62-8ad5-4f44-9ca4-b1ba2235fb74 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "POST /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/action" status: 202 len: 0 microversion: 2.1 time: 0.302521 Sep 26 18:12:26.397051 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 469/922] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Sep 26 18:12:26 2022] POST /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 18:12:26.406214 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-250adf44-66fd-4813-92a4-75d15067db9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:26.411689 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-250adf44-66fd-4813-92a4-75d15067db9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:26.421314 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-250adf44-66fd-4813-92a4-75d15067db9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:26.421814 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-250adf44-66fd-4813-92a4-75d15067db9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:26.422250 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-250adf44-66fd-4813-92a4-75d15067db9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:26.422985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-250adf44-66fd-4813-92a4-75d15067db9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:26.423473 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-250adf44-66fd-4813-92a4-75d15067db9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:26.423926 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-250adf44-66fd-4813-92a4-75d15067db9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:26.575953 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-250adf44-66fd-4813-92a4-75d15067db9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:26.589257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-250adf44-66fd-4813-92a4-75d15067db9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1665 microversion: 2.1 time: 0.187694 Sep 26 18:12:26.597253 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 454/923] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:26 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1665 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:12:27.617581 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a97a60ee-c8ec-41c8-9b4e-2557af0706ad tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:27.618195 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a97a60ee-c8ec-41c8-9b4e-2557af0706ad tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:27.625058 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a97a60ee-c8ec-41c8-9b4e-2557af0706ad tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:27.625693 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a97a60ee-c8ec-41c8-9b4e-2557af0706ad tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:27.626131 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a97a60ee-c8ec-41c8-9b4e-2557af0706ad tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:27.626830 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a97a60ee-c8ec-41c8-9b4e-2557af0706ad tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:27.627294 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a97a60ee-c8ec-41c8-9b4e-2557af0706ad tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:27.627756 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a97a60ee-c8ec-41c8-9b4e-2557af0706ad tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:27.774992 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a97a60ee-c8ec-41c8-9b4e-2557af0706ad tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:27.784938 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a97a60ee-c8ec-41c8-9b4e-2557af0706ad tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1665 microversion: 2.1 time: 0.173057 Sep 26 18:12:27.785525 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 470/924] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:27 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1665 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:12:28.808697 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f9ecac0a-49d6-46b0-b694-785554195572 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:28.809316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f9ecac0a-49d6-46b0-b694-785554195572 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:28.816000 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9ecac0a-49d6-46b0-b694-785554195572 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:28.816495 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9ecac0a-49d6-46b0-b694-785554195572 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:28.816931 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9ecac0a-49d6-46b0-b694-785554195572 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:28.817721 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9ecac0a-49d6-46b0-b694-785554195572 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:28.818212 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9ecac0a-49d6-46b0-b694-785554195572 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:28.818642 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f9ecac0a-49d6-46b0-b694-785554195572 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:28.954326 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f9ecac0a-49d6-46b0-b694-785554195572 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:28.962652 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f9ecac0a-49d6-46b0-b694-785554195572 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1669 microversion: 2.1 time: 0.158005 Sep 26 18:12:28.968288 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 455/925] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:12:28 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:37.576790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9431a21d-3b1a-47c1-a66b-50485d9cd475 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e45e8608-10ba-4bf3-8325-d7d9e06349f5", "device": "/dev/sdb"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:12:37.579872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9431a21d-3b1a-47c1-a66b-50485d9cd475 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:37.587691 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9431a21d-3b1a-47c1-a66b-50485d9cd475 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:37.588256 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9431a21d-3b1a-47c1-a66b-50485d9cd475 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:37.588724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9431a21d-3b1a-47c1-a66b-50485d9cd475 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:37.589486 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9431a21d-3b1a-47c1-a66b-50485d9cd475 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:37.589945 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9431a21d-3b1a-47c1-a66b-50485d9cd475 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:37.590377 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9431a21d-3b1a-47c1-a66b-50485d9cd475 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:38.471308 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9431a21d-3b1a-47c1-a66b-50485d9cd475 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "POST /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.898697 Sep 26 18:12:38.472274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 471/926] 10.222.0.67 () {60 vars in 1323 bytes} [Mon Sep 26 18:12:37 2022] POST /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc/os-volume_attachments => generated 194 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:12:41.033529 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a184b778-b984-4cfb-b146-82070475f4d7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:41.036118 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a184b778-b984-4cfb-b146-82070475f4d7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:41.038786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=27 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:41.039671 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=25 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:41.045137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a184b778-b984-4cfb-b146-82070475f4d7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:41.045796 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a184b778-b984-4cfb-b146-82070475f4d7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:41.046338 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a184b778-b984-4cfb-b146-82070475f4d7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:41.047291 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a184b778-b984-4cfb-b146-82070475f4d7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:41.047928 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a184b778-b984-4cfb-b146-82070475f4d7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:41.048429 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a184b778-b984-4cfb-b146-82070475f4d7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:41.082478 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a184b778-b984-4cfb-b146-82070475f4d7 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052761 Sep 26 18:12:41.083055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 456/927] 10.222.0.67 () {60 vars in 1343 bytes} [Mon Sep 26 18:12:41 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:12:41.158518 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f61d3611-e741-4e12-864d-07c81051c9a2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:41.159156 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f61d3611-e741-4e12-864d-07c81051c9a2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:41.166654 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f61d3611-e741-4e12-864d-07c81051c9a2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:41.167188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f61d3611-e741-4e12-864d-07c81051c9a2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:41.167622 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f61d3611-e741-4e12-864d-07c81051c9a2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:41.168386 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f61d3611-e741-4e12-864d-07c81051c9a2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:41.168867 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f61d3611-e741-4e12-864d-07c81051c9a2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:41.169266 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f61d3611-e741-4e12-864d-07c81051c9a2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:41.197059 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f61d3611-e741-4e12-864d-07c81051c9a2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Going to try to terminate instance {{(pid=121029) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:12:41.495552 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f61d3611-e741-4e12-864d-07c81051c9a2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "DELETE /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 204 len: 0 microversion: 2.20 time: 0.342143 Sep 26 18:12:41.496210 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 472/928] 10.222.0.67 () {60 vars in 1280 bytes} [Mon Sep 26 18:12:41 2022] DELETE /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 18:12:41.508126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-dedb9e9b-14ad-4516-8049-a4a4ff7d378a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:41.508738 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-dedb9e9b-14ad-4516-8049-a4a4ff7d378a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:41.515298 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dedb9e9b-14ad-4516-8049-a4a4ff7d378a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:41.515818 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dedb9e9b-14ad-4516-8049-a4a4ff7d378a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:41.516254 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dedb9e9b-14ad-4516-8049-a4a4ff7d378a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:41.516945 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dedb9e9b-14ad-4516-8049-a4a4ff7d378a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:41.517396 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dedb9e9b-14ad-4516-8049-a4a4ff7d378a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:41.517821 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dedb9e9b-14ad-4516-8049-a4a4ff7d378a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:41.656740 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-dedb9e9b-14ad-4516-8049-a4a4ff7d378a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:41.666206 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-dedb9e9b-14ad-4516-8049-a4a4ff7d378a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:41.667907 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-dedb9e9b-14ad-4516-8049-a4a4ff7d378a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:41.669112 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-dedb9e9b-14ad-4516-8049-a4a4ff7d378a tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1723 microversion: 2.20 time: 0.166390 Sep 26 18:12:41.669709 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 457/929] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:12:41 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:12:42.697532 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-3238e67d-c667-4fe6-93a7-cacf02cf20b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:42.698608 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3238e67d-c667-4fe6-93a7-cacf02cf20b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:42.706464 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3238e67d-c667-4fe6-93a7-cacf02cf20b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:42.707220 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3238e67d-c667-4fe6-93a7-cacf02cf20b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:42.707703 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3238e67d-c667-4fe6-93a7-cacf02cf20b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:42.708617 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3238e67d-c667-4fe6-93a7-cacf02cf20b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:42.709090 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3238e67d-c667-4fe6-93a7-cacf02cf20b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:42.709629 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3238e67d-c667-4fe6-93a7-cacf02cf20b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:42.850524 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3238e67d-c667-4fe6-93a7-cacf02cf20b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:42.859593 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3238e67d-c667-4fe6-93a7-cacf02cf20b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:42.861070 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3238e67d-c667-4fe6-93a7-cacf02cf20b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:42.862264 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-3238e67d-c667-4fe6-93a7-cacf02cf20b2 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1723 microversion: 2.20 time: 0.171424 Sep 26 18:12:42.862827 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 473/930] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:12:42 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:12:43.887952 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-62bfd6a6-3442-4315-8dc4-0e6e0515b817 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:43.888561 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-62bfd6a6-3442-4315-8dc4-0e6e0515b817 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:43.904633 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-62bfd6a6-3442-4315-8dc4-0e6e0515b817 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:43.910660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-62bfd6a6-3442-4315-8dc4-0e6e0515b817 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:43.910660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-62bfd6a6-3442-4315-8dc4-0e6e0515b817 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:43.910660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-62bfd6a6-3442-4315-8dc4-0e6e0515b817 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:43.910660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-62bfd6a6-3442-4315-8dc4-0e6e0515b817 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:43.911242 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-62bfd6a6-3442-4315-8dc4-0e6e0515b817 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:44.017405 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-62bfd6a6-3442-4315-8dc4-0e6e0515b817 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:44.031341 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-62bfd6a6-3442-4315-8dc4-0e6e0515b817 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:44.032819 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-62bfd6a6-3442-4315-8dc4-0e6e0515b817 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:44.033991 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-62bfd6a6-3442-4315-8dc4-0e6e0515b817 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1655 microversion: 2.20 time: 0.150086 Sep 26 18:12:44.034554 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 458/931] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:12:43 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1655 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 18:12:44.279807 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-e64dfa03-fa07-4fcb-bda7-f04fe40980b6 req-a6ef4298-2d87-4c02-850b-98564db4ee6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157c830f-c695-4a1a-a21f-1d0d6c24dd93", "name": "network-vif-deleted", "tag": "4810d7ad-3670-4d57-835a-ea0d6344ef48"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:12:44.293867 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-e64dfa03-fa07-4fcb-bda7-f04fe40980b6 req-a6ef4298-2d87-4c02-850b-98564db4ee6f service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:44.294646 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-e64dfa03-fa07-4fcb-bda7-f04fe40980b6 req-a6ef4298-2d87-4c02-850b-98564db4ee6f service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:44.295092 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-e64dfa03-fa07-4fcb-bda7-f04fe40980b6 req-a6ef4298-2d87-4c02-850b-98564db4ee6f service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:44.311017 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-e64dfa03-fa07-4fcb-bda7-f04fe40980b6 req-a6ef4298-2d87-4c02-850b-98564db4ee6f service nova] Creating event network-vif-deleted:4810d7ad-3670-4d57-835a-ea0d6344ef48 for instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 on hv-cinder-85931 Sep 26 18:12:44.317678 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-e64dfa03-fa07-4fcb-bda7-f04fe40980b6 req-a6ef4298-2d87-4c02-850b-98564db4ee6f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041745 Sep 26 18:12:44.318309 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 474/932] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:12:45.061030 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c337a6a4-58f7-4d58-94de-09bf3f78c66b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:45.061718 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c337a6a4-58f7-4d58-94de-09bf3f78c66b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:45.069090 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c337a6a4-58f7-4d58-94de-09bf3f78c66b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:45.069576 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c337a6a4-58f7-4d58-94de-09bf3f78c66b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:45.070006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c337a6a4-58f7-4d58-94de-09bf3f78c66b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:45.070700 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c337a6a4-58f7-4d58-94de-09bf3f78c66b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:45.072219 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c337a6a4-58f7-4d58-94de-09bf3f78c66b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:45.072219 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c337a6a4-58f7-4d58-94de-09bf3f78c66b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:45.109161 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c337a6a4-58f7-4d58-94de-09bf3f78c66b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:45.109752 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c337a6a4-58f7-4d58-94de-09bf3f78c66b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:45.110197 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c337a6a4-58f7-4d58-94de-09bf3f78c66b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:45.110653 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-c337a6a4-58f7-4d58-94de-09bf3f78c66b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lazy-loading 'fault' on Instance uuid 157c830f-c695-4a1a-a21f-1d0d6c24dd93 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:12:45.164769 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c337a6a4-58f7-4d58-94de-09bf3f78c66b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:45.174209 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c337a6a4-58f7-4d58-94de-09bf3f78c66b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:45.176588 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c337a6a4-58f7-4d58-94de-09bf3f78c66b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612875c8fc7240e5b18fe38a034a3ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6595854cfb04a11994c6aed8f5857c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:12:45.177871 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c337a6a4-58f7-4d58-94de-09bf3f78c66b tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 200 len: 1371 microversion: 2.20 time: 0.121463 Sep 26 18:12:45.178430 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 459/933] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:12:45 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 1371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 18:12:46.218835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-642ede2f-730c-4b04-b51a-2a7901189317 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:46.219569 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-642ede2f-730c-4b04-b51a-2a7901189317 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:46.227363 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-642ede2f-730c-4b04-b51a-2a7901189317 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:46.227927 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-642ede2f-730c-4b04-b51a-2a7901189317 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:46.228280 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-642ede2f-730c-4b04-b51a-2a7901189317 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:46.228983 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-642ede2f-730c-4b04-b51a-2a7901189317 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:46.229465 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-642ede2f-730c-4b04-b51a-2a7901189317 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:46.229898 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-642ede2f-730c-4b04-b51a-2a7901189317 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:46.244669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-642ede2f-730c-4b04-b51a-2a7901189317 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] HTTP exception thrown: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-642ede2f-730c-4b04-b51a-2a7901189317 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Request method failure captured: Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 HTTP/1.1 Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMenrtk5tq13JBXVAzsMWnII01d7pczbpHO-Wh5dDgiQyfwVHwgJOAbHWwWhF7ai29v3_EegLdtL6MVLOB7qy_dLjjIXLuW0WRpc0k6HHsT7j9UrX9GK3Tzj3LdzplQ9GocPQ4OAzK-C23LAV0H9Y_uWHFbzxwxAVd9muaG-Gjibyhvw Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: f6595854cfb04a11994c6aed8f5857c6 Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:12:46.246235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:12:46.252075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:12:46.252075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:12:46.252075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: f6595854cfb04a11994c6aed8f5857c6 Sep 26 18:12:46.252075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:12:46.252075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-AttachVolumeShelveTestJSON-1964894886-project Sep 26 18:12:46.252075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:12:46.252075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:12:46.252075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 612875c8fc7240e5b18fe38a034a3ef5 Sep 26 18:12:46.252075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1964894886-project Sep 26 18:12:46.252075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:12:46.252075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. Sep 26 18:12:46.252075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': '157c830f-c695-4a1a-a21f-1d0d6c24dd93'} Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:12:46.253107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. Sep 26 18:12:46.254759 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:46.256199 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-642ede2f-730c-4b04-b51a-2a7901189317 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Returning 404 to user: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:12:46.256199 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-642ede2f-730c-4b04-b51a-2a7901189317 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 404 len: 111 microversion: 2.20 time: 0.033324 Sep 26 18:12:46.256199 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 475/934] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:12:46 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 18:12:46.257106 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-61811ebd-ec76-48e7-9f88-0c3c73af2e9e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '.version_select at 0x7f3a782aed30>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:46.370958 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-61811ebd-ec76-48e7-9f88-0c3c73af2e9e tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-421030644" status: 204 len: 0 microversion: 2.20 time: 0.117816 Sep 26 18:12:46.371543 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 460/935] 10.222.0.67 () {60 vars in 1259 bytes} [Mon Sep 26 18:12:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-421030644 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 18:12:48.578431 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a0c002ca-e381-44b5-8961-615a3be18c3d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:48.579251 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a0c002ca-e381-44b5-8961-615a3be18c3d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:48.592246 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a0c002ca-e381-44b5-8961-615a3be18c3d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:48.592836 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a0c002ca-e381-44b5-8961-615a3be18c3d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:48.593271 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a0c002ca-e381-44b5-8961-615a3be18c3d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:48.593992 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a0c002ca-e381-44b5-8961-615a3be18c3d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:48.594575 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a0c002ca-e381-44b5-8961-615a3be18c3d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:48.595241 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a0c002ca-e381-44b5-8961-615a3be18c3d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:48.612028 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-a0c002ca-e381-44b5-8961-615a3be18c3d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] HTTP exception thrown: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a0c002ca-e381-44b5-8961-615a3be18c3d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Request method failure captured: Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: DELETE /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 HTTP/1.1 Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMenrtk5tq13JBXVAzsMWnII01d7pczbpHO-Wh5dDgiQyfwVHwgJOAbHWwWhF7ai29v3_EegLdtL6MVLOB7qy_dLjjIXLuW0WRpc0k6HHsT7j9UrX9GK3Tzj3LdzplQ9GocPQ4OAzK-C23LAV0H9Y_uWHFbzxwxAVd9muaG-Gjibyhvw Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: f6595854cfb04a11994c6aed8f5857c6 Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:12:48.614188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:12:48.619724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:12:48.619724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:12:48.619724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: f6595854cfb04a11994c6aed8f5857c6 Sep 26 18:12:48.619724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:12:48.619724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-AttachVolumeShelveTestJSON-1964894886-project Sep 26 18:12:48.619724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:12:48.619724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:12:48.619724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 612875c8fc7240e5b18fe38a034a3ef5 Sep 26 18:12:48.619724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1964894886-project Sep 26 18:12:48.619724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:12:48.619724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. Sep 26 18:12:48.619724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': '157c830f-c695-4a1a-a21f-1d0d6c24dd93'} Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:12:48.620634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. Sep 26 18:12:48.622153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:48.623596 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a0c002ca-e381-44b5-8961-615a3be18c3d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Returning 404 to user: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:12:48.623596 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a0c002ca-e381-44b5-8961-615a3be18c3d tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "DELETE /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 404 len: 111 microversion: 2.20 time: 0.041456 Sep 26 18:12:48.623596 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 476/936] 10.222.0.67 () {60 vars in 1280 bytes} [Mon Sep 26 18:12:48 2022] DELETE /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 26 18:12:48.625354 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-be732007-5ae8-4144-bcc0-f98f94e04287 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:48.626092 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-be732007-5ae8-4144-bcc0-f98f94e04287 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: 157c830f-c695-4a1a-a21f-1d0d6c24dd93] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:48.634605 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be732007-5ae8-4144-bcc0-f98f94e04287 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:48.635093 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be732007-5ae8-4144-bcc0-f98f94e04287 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:48.635580 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be732007-5ae8-4144-bcc0-f98f94e04287 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:48.636313 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be732007-5ae8-4144-bcc0-f98f94e04287 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:48.636769 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be732007-5ae8-4144-bcc0-f98f94e04287 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:48.637192 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-be732007-5ae8-4144-bcc0-f98f94e04287 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:48.653586 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-be732007-5ae8-4144-bcc0-f98f94e04287 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] HTTP exception thrown: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-be732007-5ae8-4144-bcc0-f98f94e04287 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Request method failure captured: Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 HTTP/1.1 Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMenrtk5tq13JBXVAzsMWnII01d7pczbpHO-Wh5dDgiQyfwVHwgJOAbHWwWhF7ai29v3_EegLdtL6MVLOB7qy_dLjjIXLuW0WRpc0k6HHsT7j9UrX9GK3Tzj3LdzplQ9GocPQ4OAzK-C23LAV0H9Y_uWHFbzxwxAVd9muaG-Gjibyhvw Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: f6595854cfb04a11994c6aed8f5857c6 Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:12:48.655900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:12:48.659167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:12:48.659167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:12:48.659167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: f6595854cfb04a11994c6aed8f5857c6 Sep 26 18:12:48.659167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:12:48.659167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-AttachVolumeShelveTestJSON-1964894886-project Sep 26 18:12:48.659167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:12:48.659167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:12:48.659167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 612875c8fc7240e5b18fe38a034a3ef5 Sep 26 18:12:48.659167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1964894886-project Sep 26 18:12:48.659167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:12:48.659167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. Sep 26 18:12:48.659167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '157c830f-c695-4a1a-a21f-1d0d6c24dd93'} Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:12:48.660813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. Sep 26 18:12:48.662154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:12:48.663449 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-be732007-5ae8-4144-bcc0-f98f94e04287 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Returning 404 to user: Instance 157c830f-c695-4a1a-a21f-1d0d6c24dd93 could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:12:48.663449 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-be732007-5ae8-4144-bcc0-f98f94e04287 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93" status: 404 len: 111 microversion: 2.20 time: 0.035976 Sep 26 18:12:48.663449 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 461/937] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:12:48 2022] GET /compute/v2.1/servers/157c830f-c695-4a1a-a21f-1d0d6c24dd93 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 26 18:12:52.119259 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5098a31c-4c6c-4579-a454-02e968471569 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:52.119780 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-5098a31c-4c6c-4579-a454-02e968471569 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:52.122243 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:52.126979 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5098a31c-4c6c-4579-a454-02e968471569 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:52.127473 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5098a31c-4c6c-4579-a454-02e968471569 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:52.127942 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5098a31c-4c6c-4579-a454-02e968471569 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:52.128674 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5098a31c-4c6c-4579-a454-02e968471569 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:52.129466 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5098a31c-4c6c-4579-a454-02e968471569 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:52.129884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5098a31c-4c6c-4579-a454-02e968471569 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-5098a31c-4c6c-4579-a454-02e968471569 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] HTTP exception thrown: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5098a31c-4c6c-4579-a454-02e968471569 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Request method failure captured: Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: DELETE /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 HTTP/1.1 Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMenrtk5tq13JBXVAzsMWnII01d7pczbpHO-Wh5dDgiQyfwVHwgJOAbHWwWhF7ai29v3_EegLdtL6MVLOB7qy_dLjjIXLuW0WRpc0k6HHsT7j9UrX9GK3Tzj3LdzplQ9GocPQ4OAzK-C23LAV0H9Y_uWHFbzxwxAVd9muaG-Gjibyhvw Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: f6595854cfb04a11994c6aed8f5857c6 Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:12:52.152293 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:12:52.154609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:12:52.154609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:12:52.154609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: f6595854cfb04a11994c6aed8f5857c6 Sep 26 18:12:52.154609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:12:52.154609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-AttachVolumeShelveTestJSON-1964894886-project Sep 26 18:12:52.154609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:12:52.154609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:12:52.154609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 612875c8fc7240e5b18fe38a034a3ef5 Sep 26 18:12:52.154609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1964894886-project Sep 26 18:12:52.154609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:12:52.154609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. Sep 26 18:12:52.154609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': 'f6298d28-8cba-46d8-a809-bd0f81e18d58'} Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:12:52.155601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. Sep 26 18:12:52.156877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:12:52.158208 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5098a31c-4c6c-4579-a454-02e968471569 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Returning 404 to user: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:12:52.158208 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5098a31c-4c6c-4579-a454-02e968471569 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 404 len: 111 microversion: 2.20 time: 0.032593 Sep 26 18:12:52.158208 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 477/938] 10.222.0.67 () {60 vars in 1280 bytes} [Mon Sep 26 18:12:52 2022] DELETE /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 18:12:52.159183 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f16fb8a6-6c3b-45c7-aa58-2552d7568874 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:52.160409 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f16fb8a6-6c3b-45c7-aa58-2552d7568874 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] [instance: f6298d28-8cba-46d8-a809-bd0f81e18d58] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:12:52.167281 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f16fb8a6-6c3b-45c7-aa58-2552d7568874 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:52.167799 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f16fb8a6-6c3b-45c7-aa58-2552d7568874 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:52.175275 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f16fb8a6-6c3b-45c7-aa58-2552d7568874 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:52.175275 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f16fb8a6-6c3b-45c7-aa58-2552d7568874 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:12:52.175275 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f16fb8a6-6c3b-45c7-aa58-2552d7568874 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:12:52.175275 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f16fb8a6-6c3b-45c7-aa58-2552d7568874 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:12:52.183866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-f16fb8a6-6c3b-45c7-aa58-2552d7568874 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] HTTP exception thrown: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f16fb8a6-6c3b-45c7-aa58-2552d7568874 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Request method failure captured: Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 HTTP/1.1 Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMenrtk5tq13JBXVAzsMWnII01d7pczbpHO-Wh5dDgiQyfwVHwgJOAbHWwWhF7ai29v3_EegLdtL6MVLOB7qy_dLjjIXLuW0WRpc0k6HHsT7j9UrX9GK3Tzj3LdzplQ9GocPQ4OAzK-C23LAV0H9Y_uWHFbzxwxAVd9muaG-Gjibyhvw Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: f6595854cfb04a11994c6aed8f5857c6 Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:12:52.185439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:12:52.186927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f6595854cfb04a11994c6aed8f5857c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:12:52.186927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:12:52.186927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: f6595854cfb04a11994c6aed8f5857c6 Sep 26 18:12:52.186927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1964894886 Sep 26 18:12:52.186927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-AttachVolumeShelveTestJSON-1964894886-project Sep 26 18:12:52.186927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:12:52.186927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:12:52.186927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 612875c8fc7240e5b18fe38a034a3ef5 Sep 26 18:12:52.186927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1964894886-project Sep 26 18:12:52.186927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:12:52.186927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. Sep 26 18:12:52.186927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': 'f6298d28-8cba-46d8-a809-bd0f81e18d58'} Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:12:52.187951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. Sep 26 18:12:52.189385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:12:52.190790 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f16fb8a6-6c3b-45c7-aa58-2552d7568874 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] Returning 404 to user: Instance f6298d28-8cba-46d8-a809-bd0f81e18d58 could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:12:52.190790 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f16fb8a6-6c3b-45c7-aa58-2552d7568874 tempest-AttachVolumeShelveTestJSON-1964894886 tempest-AttachVolumeShelveTestJSON-1964894886-project] 10.222.0.67 "GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58" status: 404 len: 111 microversion: 2.20 time: 0.031504 Sep 26 18:12:52.190790 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 462/939] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Sep 26 18:12:52 2022] GET /compute/v2.1/servers/f6298d28-8cba-46d8-a809-bd0f81e18d58 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 26 18:12:58.036571 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-dfb4e510-cdd9-4002-9bd0-d605f8f7bdc9 tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] Action: 'create', calling method: .version_select at 0x7f3a74a0eaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-82523432", "metadata": {"Type": "work"}}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:12:58.698157 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-dfb4e510-cdd9-4002-9bd0-d605f8f7bdc9 tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.785389 Sep 26 18:12:58.698800 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 478/940] 10.222.0.67 () {60 vars in 1156 bytes} [Mon Sep 26 18:12:57 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 787 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 26 18:12:58.712465 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d5521cd1-e7d5-415b-93c8-e6b4a1f36bb9 tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] Calling method '.version_select at 0x7f3a7827be50>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:58.762482 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d5521cd1-e7d5-415b-93c8-e6b4a1f36bb9 tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/32ef2a05-e25c-4e19-a11f-689dc362577f" status: 200 len: 351 microversion: 2.1 time: 0.053807 Sep 26 18:12:58.763280 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 463/941] 10.222.0.67 () {58 vars in 1245 bytes} [Mon Sep 26 18:12:58 2022] GET /compute/v2.1/os-volumes/32ef2a05-e25c-4e19-a11f-689dc362577f => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:12:59.777926 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-79dc6b06-6ae5-4290-a3fb-da56344c0a0a tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] Calling method '.version_select at 0x7f3a74d8df70>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:12:59.827970 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-79dc6b06-6ae5-4290-a3fb-da56344c0a0a tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/32ef2a05-e25c-4e19-a11f-689dc362577f" status: 200 len: 351 microversion: 2.1 time: 0.054372 Sep 26 18:12:59.828550 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 479/942] 10.222.0.67 () {58 vars in 1245 bytes} [Mon Sep 26 18:12:59 2022] GET /compute/v2.1/os-volumes/32ef2a05-e25c-4e19-a11f-689dc362577f => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:13:00.843059 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8c709307-8f80-4ade-8d0f-e83664e913d9 tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] Calling method '.version_select at 0x7f3a74aa4af0>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:00.891212 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8c709307-8f80-4ade-8d0f-e83664e913d9 tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/32ef2a05-e25c-4e19-a11f-689dc362577f" status: 200 len: 352 microversion: 2.1 time: 0.052552 Sep 26 18:13:00.891941 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 464/943] 10.222.0.67 () {58 vars in 1245 bytes} [Mon Sep 26 18:13:00 2022] GET /compute/v2.1/os-volumes/32ef2a05-e25c-4e19-a11f-689dc362577f => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:13:00.905724 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8f123849-f846-440f-984d-26bd37186165 tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] Calling method '.version_select at 0x7f3a74c0f1f0>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:00.954474 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-8f123849-f846-440f-984d-26bd37186165 tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/32ef2a05-e25c-4e19-a11f-689dc362577f" status: 200 len: 352 microversion: 2.1 time: 0.052951 Sep 26 18:13:00.955193 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 480/944] 10.222.0.67 () {58 vars in 1245 bytes} [Mon Sep 26 18:13:00 2022] GET /compute/v2.1/os-volumes/32ef2a05-e25c-4e19-a11f-689dc362577f => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:13:00.975024 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2ae818be-cee3-403f-90dd-8f6ae177adea tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] Calling method '.version_select at 0x7f3a74b0cca0>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:01.234335 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2ae818be-cee3-403f-90dd-8f6ae177adea tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/32ef2a05-e25c-4e19-a11f-689dc362577f" status: 202 len: 0 microversion: 2.1 time: 0.256315 Sep 26 18:13:01.234335 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 465/945] 10.222.0.67 () {58 vars in 1248 bytes} [Mon Sep 26 18:13:00 2022] DELETE /compute/v2.1/os-volumes/32ef2a05-e25c-4e19-a11f-689dc362577f => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:13:01.239591 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-92a22177-2628-49ec-9ba8-a4fcbae0a27a tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] Calling method '.version_select at 0x7f3a74a401f0>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:01.288149 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-92a22177-2628-49ec-9ba8-a4fcbae0a27a tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/32ef2a05-e25c-4e19-a11f-689dc362577f" status: 200 len: 351 microversion: 2.1 time: 0.052567 Sep 26 18:13:01.288741 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 481/946] 10.222.0.67 () {58 vars in 1245 bytes} [Mon Sep 26 18:13:01 2022] GET /compute/v2.1/os-volumes/32ef2a05-e25c-4e19-a11f-689dc362577f => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:13:02.299766 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:02.301796 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=30 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:02.305375 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f339e7e6-3e30-4bf0-a731-b309e39d5d71 tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] Calling method '.version_select at 0x7f3a782ae8b0>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:02.333752 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-f339e7e6-3e30-4bf0-a731-b309e39d5d71 tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] HTTP exception thrown: Volume 32ef2a05-e25c-4e19-a11f-689dc362577f could not be found. Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f339e7e6-3e30-4bf0-a731-b309e39d5d71 tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] Request method failure captured: Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/os-volumes/32ef2a05-e25c-4e19-a11f-689dc362577f HTTP/1.1 Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMeup-istFeaG7ha23eAtA3t5F05O6iXd5b-koD83Vaq26oFHwjFO_wUKxK2nHbW4QjtG5CsdQpDxC61lK7e0lobbe44OFH9Cvwg3TA4jAXCvdhF5xDw3nbo-m7lzoSXa5w-CFajNj7sTO3nNqL3qUQ7nNUZmFJ7nTfSywxbhzwwOSMI Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 66c83d0e9a3a43e2a0a7e9a51315c9f6 Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-VolumesGetTestJSON-1492505758 Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:13:02.335765 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:13:02.337479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66c83d0e9a3a43e2a0a7e9a51315c9f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66c83d0e9a3a43e2a0a7e9a51315c9f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_66c83d0e9a3a43e2a0a7e9a51315c9f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/66c83d0e9a3a43e2a0a7e9a51315c9f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:13:02.337479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-VolumesGetTestJSON-1492505758 Sep 26 18:13:02.337479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 66c83d0e9a3a43e2a0a7e9a51315c9f6 Sep 26 18:13:02.337479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-VolumesGetTestJSON-1492505758 Sep 26 18:13:02.337479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-VolumesGetTestJSON-1492505758-project Sep 26 18:13:02.337479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:13:02.337479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:13:02.337479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 87221b278f764a4e83148733be19106c Sep 26 18:13:02.337479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-VolumesGetTestJSON-1492505758-project Sep 26 18:13:02.337479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: Sep 26 18:13:02.337479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Volume 32ef2a05-e25c-4e19-a11f-689dc362577f could not be found. Sep 26 18:13:02.337479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '32ef2a05-e25c-4e19-a11f-689dc362577f'} Sep 26 18:13:02.337479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32ef2a05-e25c-4e19-a11f-689dc362577f could not be found. (HTTP 404) (Request-ID: req-af34b34d-12dd-4558-b4c9-c1c5dadc3222) Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:13:02.338567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 18:13:02.342146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32ef2a05-e25c-4e19-a11f-689dc362577f could not be found. Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 18:13:02.344033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:13:02.345660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32ef2a05-e25c-4e19-a11f-689dc362577f could not be found. Sep 26 18:13:02.345660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:02.345660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:13:02.345660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:02.345660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:13:02.345660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:13:02.345660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:13:02.345660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:13:02.345660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:13:02.345660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32ef2a05-e25c-4e19-a11f-689dc362577f could not be found. Sep 26 18:13:02.345660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:02.345660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f339e7e6-3e30-4bf0-a731-b309e39d5d71 tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] Returning 404 to user: Volume 32ef2a05-e25c-4e19-a11f-689dc362577f could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:13:02.345660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f339e7e6-3e30-4bf0-a731-b309e39d5d71 tempest-VolumesGetTestJSON-1492505758 tempest-VolumesGetTestJSON-1492505758-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/32ef2a05-e25c-4e19-a11f-689dc362577f" status: 404 len: 109 microversion: 2.1 time: 0.038789 Sep 26 18:13:02.345660 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 466/947] 10.222.0.67 () {58 vars in 1245 bytes} [Mon Sep 26 18:13:02 2022] GET /compute/v2.1/os-volumes/32ef2a05-e25c-4e19-a11f-689dc362577f => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:13:04.750352 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:04.755497 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-108ef452-7213-440e-a43b-a87d8553524a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:04.756234 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-108ef452-7213-440e-a43b-a87d8553524a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:04.763113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-108ef452-7213-440e-a43b-a87d8553524a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:04.763610 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-108ef452-7213-440e-a43b-a87d8553524a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:04.764083 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-108ef452-7213-440e-a43b-a87d8553524a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:04.764790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-108ef452-7213-440e-a43b-a87d8553524a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:04.765247 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-108ef452-7213-440e-a43b-a87d8553524a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:04.765678 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-108ef452-7213-440e-a43b-a87d8553524a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:04.850309 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-108ef452-7213-440e-a43b-a87d8553524a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lazy-loading 'services' on Instance uuid 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:13:05.170243 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-108ef452-7213-440e-a43b-a87d8553524a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc/os-volume_attachments/e45e8608-10ba-4bf3-8325-d7d9e06349f5" status: 202 len: 0 microversion: 2.1 time: 0.420828 Sep 26 18:13:05.175848 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 482/948] 10.222.0.67 () {58 vars in 1416 bytes} [Mon Sep 26 18:13:04 2022] DELETE /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc/os-volume_attachments/e45e8608-10ba-4bf3-8325-d7d9e06349f5 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:13:07.365855 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-7a67d36b-e67d-4133-8920-6efdecc5ac9d tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:07.366429 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-7a67d36b-e67d-4133-8920-6efdecc5ac9d tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:07.373043 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a67d36b-e67d-4133-8920-6efdecc5ac9d tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:07.373531 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a67d36b-e67d-4133-8920-6efdecc5ac9d tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:07.373966 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a67d36b-e67d-4133-8920-6efdecc5ac9d tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:07.374657 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a67d36b-e67d-4133-8920-6efdecc5ac9d tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:07.375114 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a67d36b-e67d-4133-8920-6efdecc5ac9d tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:07.375538 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a67d36b-e67d-4133-8920-6efdecc5ac9d tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:07.401589 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-7a67d36b-e67d-4133-8920-6efdecc5ac9d tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Going to try to terminate instance {{(pid=121028) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:13:07.718021 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-7a67d36b-e67d-4133-8920-6efdecc5ac9d tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 204 len: 0 microversion: 2.1 time: 0.358001 Sep 26 18:13:07.718826 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 467/949] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:13:07 2022] DELETE /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:13:07.729313 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ce2a2eba-a1b6-4af4-8f84-e601e9afa9fd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:07.730008 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ce2a2eba-a1b6-4af4-8f84-e601e9afa9fd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:07.736882 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ce2a2eba-a1b6-4af4-8f84-e601e9afa9fd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:07.737400 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ce2a2eba-a1b6-4af4-8f84-e601e9afa9fd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:07.738404 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ce2a2eba-a1b6-4af4-8f84-e601e9afa9fd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:07.739100 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ce2a2eba-a1b6-4af4-8f84-e601e9afa9fd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:07.739559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ce2a2eba-a1b6-4af4-8f84-e601e9afa9fd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:07.740039 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ce2a2eba-a1b6-4af4-8f84-e601e9afa9fd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:07.869689 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ce2a2eba-a1b6-4af4-8f84-e601e9afa9fd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:07.877690 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ce2a2eba-a1b6-4af4-8f84-e601e9afa9fd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1514 microversion: 2.1 time: 0.153368 Sep 26 18:13:07.891667 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 483/950] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:07 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:13:08.902930 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6dd7593e-0704-443d-bd7e-fbbb35e2f532 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:08.903672 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-6dd7593e-0704-443d-bd7e-fbbb35e2f532 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:08.910662 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6dd7593e-0704-443d-bd7e-fbbb35e2f532 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:08.911322 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6dd7593e-0704-443d-bd7e-fbbb35e2f532 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:08.911852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6dd7593e-0704-443d-bd7e-fbbb35e2f532 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:08.912604 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6dd7593e-0704-443d-bd7e-fbbb35e2f532 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:08.913124 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6dd7593e-0704-443d-bd7e-fbbb35e2f532 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:08.913603 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6dd7593e-0704-443d-bd7e-fbbb35e2f532 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:09.058330 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6dd7593e-0704-443d-bd7e-fbbb35e2f532 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:09.066894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-6dd7593e-0704-443d-bd7e-fbbb35e2f532 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1514 microversion: 2.1 time: 0.168107 Sep 26 18:13:09.068891 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 468/951] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:08 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:10.090403 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-35506736-c37a-402b-9f48-039d1d025b41 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:10.091040 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-35506736-c37a-402b-9f48-039d1d025b41 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:10.098407 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-35506736-c37a-402b-9f48-039d1d025b41 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:10.098920 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-35506736-c37a-402b-9f48-039d1d025b41 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:10.099354 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-35506736-c37a-402b-9f48-039d1d025b41 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:10.100073 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-35506736-c37a-402b-9f48-039d1d025b41 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:10.100531 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-35506736-c37a-402b-9f48-039d1d025b41 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:10.100955 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-35506736-c37a-402b-9f48-039d1d025b41 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:10.171135 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-35506736-c37a-402b-9f48-039d1d025b41 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:10.179149 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-35506736-c37a-402b-9f48-039d1d025b41 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1472 microversion: 2.1 time: 0.092616 Sep 26 18:13:10.180002 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 484/952] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:10 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1472 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:10.254731 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-e2282ea4-0c78-41fb-b75d-61b608090ed6 req-4faef707-b36b-4932-9db2-4ba158261536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc", "name": "network-vif-deleted", "tag": "7a1efa53-2b1f-44fd-9dd7-f4d10ce00d81"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:13:10.264898 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-e2282ea4-0c78-41fb-b75d-61b608090ed6 req-4faef707-b36b-4932-9db2-4ba158261536 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:10.265385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-e2282ea4-0c78-41fb-b75d-61b608090ed6 req-4faef707-b36b-4932-9db2-4ba158261536 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:10.265831 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-e2282ea4-0c78-41fb-b75d-61b608090ed6 req-4faef707-b36b-4932-9db2-4ba158261536 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:10.277980 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-e2282ea4-0c78-41fb-b75d-61b608090ed6 req-4faef707-b36b-4932-9db2-4ba158261536 service nova] Creating event network-vif-deleted:7a1efa53-2b1f-44fd-9dd7-f4d10ce00d81 for instance 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc on hv-cinder-85931 Sep 26 18:13:10.282885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-e2282ea4-0c78-41fb-b75d-61b608090ed6 req-4faef707-b36b-4932-9db2-4ba158261536 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032084 Sep 26 18:13:10.283641 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 469/953] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:13:11.203151 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a97aa161-e13c-4b85-9d37-9cebe96510f5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:11.203748 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a97aa161-e13c-4b85-9d37-9cebe96510f5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:11.211137 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a97aa161-e13c-4b85-9d37-9cebe96510f5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:11.212287 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a97aa161-e13c-4b85-9d37-9cebe96510f5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:11.212287 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a97aa161-e13c-4b85-9d37-9cebe96510f5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:11.212643 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a97aa161-e13c-4b85-9d37-9cebe96510f5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:11.213101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a97aa161-e13c-4b85-9d37-9cebe96510f5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:11.213770 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a97aa161-e13c-4b85-9d37-9cebe96510f5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:11.247341 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a97aa161-e13c-4b85-9d37-9cebe96510f5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:11.247864 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a97aa161-e13c-4b85-9d37-9cebe96510f5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:11.248302 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a97aa161-e13c-4b85-9d37-9cebe96510f5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:11.257953 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-a97aa161-e13c-4b85-9d37-9cebe96510f5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lazy-loading 'fault' on Instance uuid 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:13:11.291954 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a97aa161-e13c-4b85-9d37-9cebe96510f5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:11.299604 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a97aa161-e13c-4b85-9d37-9cebe96510f5 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 200 len: 1308 microversion: 2.1 time: 0.100494 Sep 26 18:13:11.300415 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 485/954] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:11 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:13:12.323603 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-485d0309-b41d-4399-8981-571bf9d2168c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:12.324856 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-485d0309-b41d-4399-8981-571bf9d2168c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:12.330897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-485d0309-b41d-4399-8981-571bf9d2168c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:12.331936 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-485d0309-b41d-4399-8981-571bf9d2168c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:12.332406 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-485d0309-b41d-4399-8981-571bf9d2168c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:12.333292 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-485d0309-b41d-4399-8981-571bf9d2168c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:12.333738 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-485d0309-b41d-4399-8981-571bf9d2168c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:12.334155 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-485d0309-b41d-4399-8981-571bf9d2168c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:12.348463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-485d0309-b41d-4399-8981-571bf9d2168c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] HTTP exception thrown: Instance 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc could not be found. Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-485d0309-b41d-4399-8981-571bf9d2168c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Request method failure captured: Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc HTTP/1.1 Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMetxczBzPtDEtjvlcFkCCAnCEWs9wl7AYNi3azV7X5GsUGBv49XV5Ka--Si1lVXFokHaIEO6BaIpmMsTePOMN7niUiceXZnbBXitwOZzhsEiDWxa3vJZU8tXtg8qbWUwPQL-WroQQxqL5zITeJx-DvlLgzVRcWyCG1NSHN-oCyd1yTM Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 518090209d9a462fbf40d6cb86c3c695 Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-VolumesSnapshotTestJSON-471786393 Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:13:12.350131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:13:12.351922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/518090209d9a462fbf40d6cb86c3c695"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/518090209d9a462fbf40d6cb86c3c695"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_518090209d9a462fbf40d6cb86c3c695"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/518090209d9a462fbf40d6cb86c3c695"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:13:12.351922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-VolumesSnapshotTestJSON-471786393 Sep 26 18:13:12.351922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 518090209d9a462fbf40d6cb86c3c695 Sep 26 18:13:12.351922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-471786393 Sep 26 18:13:12.351922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-VolumesSnapshotTestJSON-471786393-project Sep 26 18:13:12.351922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:13:12.351922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:13:12.351922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: ecf12b3f54e349d5a8f6587410c79501 Sep 26 18:13:12.351922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-VolumesSnapshotTestJSON-471786393-project Sep 26 18:13:12.351922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:13:12.351922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc could not be found. Sep 26 18:13:12.351922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc'} Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc could not be found. Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:13:12.353071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc could not be found. Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc could not be found. Sep 26 18:13:12.356065 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:12.357900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-485d0309-b41d-4399-8981-571bf9d2168c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Returning 404 to user: Instance 9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:13:12.357900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-485d0309-b41d-4399-8981-571bf9d2168c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc" status: 404 len: 111 microversion: 2.1 time: 0.032503 Sep 26 18:13:12.357900 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 470/955] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:12 2022] GET /compute/v2.1/servers/9693b1c2-b5fa-458e-bd9c-325cfc8b5dfc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:13:22.113180 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1121454232", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452", "networks": [{"uuid": "3c66d0c1-a26e-44a7-90d6-75ca678825c7"}]}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:13:22.122792 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=11 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:22.123736 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:22.387620 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.network.neutron [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] validate_networks() for [('3c66d0c1-a26e-44a7-90d6-75ca678825c7', None, None, None, None, None)] {{(pid=121029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:13:22.880856 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Flavor limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:13:22.881319 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Image limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:13:22.881802 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Flavor pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:13:22.882256 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Image pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:13:22.882678 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:13:22.892874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:22.893864 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:22.894298 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:22.895339 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:22.895940 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:22.896370 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:22.913931 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Getting quotas for project 518090209d9a462fbf40d6cb86c3c695. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:13:22.917847 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Getting quotas for user ecf12b3f54e349d5a8f6587410c79501 and project 518090209d9a462fbf40d6cb86c3c695. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:13:22.929020 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Going to run 1 instances... {{(pid=121029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:13:22.931327 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:13:23.068465 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-fcdce187-c0e4-4b16-98cd-fa2e70de2a78 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961092 Sep 26 18:13:23.069219 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 486/956] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:13:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:13:23.081404 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b3b5e7b3-fcb8-4612-8b1c-cc5b0fd8c4d6 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:23.082128 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b3b5e7b3-fcb8-4612-8b1c-cc5b0fd8c4d6 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:23.085088 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:23.085767 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:23.295398 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b3b5e7b3-fcb8-4612-8b1c-cc5b0fd8c4d6 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:23.306867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b3b5e7b3-fcb8-4612-8b1c-cc5b0fd8c4d6 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1219 microversion: 2.1 time: 0.229951 Sep 26 18:13:23.314513 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 471/957] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:23 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1219 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:24.334554 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8254d628-19e6-4e24-a191-68e33fcd927e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:24.335265 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-8254d628-19e6-4e24-a191-68e33fcd927e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:24.396666 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-8254d628-19e6-4e24-a191-68e33fcd927e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:24.407584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-8254d628-19e6-4e24-a191-68e33fcd927e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1219 microversion: 2.1 time: 0.078312 Sep 26 18:13:24.408300 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 487/958] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:24 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:25.431842 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8e5d8217-d1f6-4407-bbac-1f26ce3b39fe tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:25.432456 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-8e5d8217-d1f6-4407-bbac-1f26ce3b39fe tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:25.440442 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8e5d8217-d1f6-4407-bbac-1f26ce3b39fe tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:25.440993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8e5d8217-d1f6-4407-bbac-1f26ce3b39fe tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:25.441431 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8e5d8217-d1f6-4407-bbac-1f26ce3b39fe tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:25.442123 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8e5d8217-d1f6-4407-bbac-1f26ce3b39fe tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:25.442575 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8e5d8217-d1f6-4407-bbac-1f26ce3b39fe tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:25.442975 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8e5d8217-d1f6-4407-bbac-1f26ce3b39fe tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:25.506207 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8e5d8217-d1f6-4407-bbac-1f26ce3b39fe tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:25.513885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8e5d8217-d1f6-4407-bbac-1f26ce3b39fe tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1271 microversion: 2.1 time: 0.085980 Sep 26 18:13:25.514451 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 472/959] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:25 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:26.538500 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-44cf4c0b-b673-4e3e-9f22-8afa5b93b216 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:26.539177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-44cf4c0b-b673-4e3e-9f22-8afa5b93b216 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:26.545729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-44cf4c0b-b673-4e3e-9f22-8afa5b93b216 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:26.546246 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-44cf4c0b-b673-4e3e-9f22-8afa5b93b216 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:26.546685 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-44cf4c0b-b673-4e3e-9f22-8afa5b93b216 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:26.547387 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-44cf4c0b-b673-4e3e-9f22-8afa5b93b216 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:26.547872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-44cf4c0b-b673-4e3e-9f22-8afa5b93b216 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:26.548300 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-44cf4c0b-b673-4e3e-9f22-8afa5b93b216 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:26.629967 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-44cf4c0b-b673-4e3e-9f22-8afa5b93b216 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:26.637832 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-44cf4c0b-b673-4e3e-9f22-8afa5b93b216 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1277 microversion: 2.1 time: 0.103949 Sep 26 18:13:26.638397 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 488/960] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:26 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:27.663214 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d9ec2778-f830-4eac-9168-f7c752f1d5af tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:27.663899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d9ec2778-f830-4eac-9168-f7c752f1d5af tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:27.671095 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9ec2778-f830-4eac-9168-f7c752f1d5af tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:27.671588 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9ec2778-f830-4eac-9168-f7c752f1d5af tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:27.672030 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9ec2778-f830-4eac-9168-f7c752f1d5af tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:27.672719 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9ec2778-f830-4eac-9168-f7c752f1d5af tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:27.673175 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9ec2778-f830-4eac-9168-f7c752f1d5af tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:27.673590 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9ec2778-f830-4eac-9168-f7c752f1d5af tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:27.900848 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d9ec2778-f830-4eac-9168-f7c752f1d5af tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:27.912969 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d9ec2778-f830-4eac-9168-f7c752f1d5af tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1319 microversion: 2.1 time: 0.254483 Sep 26 18:13:27.913586 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 473/961] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:27 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:28.014380 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-b5d9f8ba-9486-42b3-a295-397d57600189 req-6eec4432-383a-40a4-953a-2e02b49670be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94bc578d-8428-4b87-99d5-003bdc0ba332", "tag": "4e8280a9-6d23-43f5-b7bd-ea29e328b808"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:13:28.026166 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-b5d9f8ba-9486-42b3-a295-397d57600189 req-6eec4432-383a-40a4-953a-2e02b49670be service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:28.026655 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-b5d9f8ba-9486-42b3-a295-397d57600189 req-6eec4432-383a-40a4-953a-2e02b49670be service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:28.027096 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-b5d9f8ba-9486-42b3-a295-397d57600189 req-6eec4432-383a-40a4-953a-2e02b49670be service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:28.039071 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-b5d9f8ba-9486-42b3-a295-397d57600189 req-6eec4432-383a-40a4-953a-2e02b49670be service nova] Creating event network-changed:4e8280a9-6d23-43f5-b7bd-ea29e328b808 for instance 94bc578d-8428-4b87-99d5-003bdc0ba332 on hv-cinder-85931 Sep 26 18:13:28.045229 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-b5d9f8ba-9486-42b3-a295-397d57600189 req-6eec4432-383a-40a4-953a-2e02b49670be service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034431 Sep 26 18:13:28.046234 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 489/962] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:13:28.937625 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6760973e-e43c-44d9-90d9-2a1a38fdc6ba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:28.938208 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-6760973e-e43c-44d9-90d9-2a1a38fdc6ba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:28.944320 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6760973e-e43c-44d9-90d9-2a1a38fdc6ba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:28.944940 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6760973e-e43c-44d9-90d9-2a1a38fdc6ba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:28.945219 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6760973e-e43c-44d9-90d9-2a1a38fdc6ba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:28.945969 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6760973e-e43c-44d9-90d9-2a1a38fdc6ba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:28.946367 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6760973e-e43c-44d9-90d9-2a1a38fdc6ba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:28.946783 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6760973e-e43c-44d9-90d9-2a1a38fdc6ba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:29.084903 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6760973e-e43c-44d9-90d9-2a1a38fdc6ba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:29.094965 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-6760973e-e43c-44d9-90d9-2a1a38fdc6ba tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1319 microversion: 2.1 time: 0.161103 Sep 26 18:13:29.095568 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 474/963] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:28 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:30.120038 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-02a26478-e95a-4013-8066-d7699fe9c3dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:30.120789 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-02a26478-e95a-4013-8066-d7699fe9c3dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:30.127773 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-02a26478-e95a-4013-8066-d7699fe9c3dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:30.128144 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-02a26478-e95a-4013-8066-d7699fe9c3dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:30.128580 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-02a26478-e95a-4013-8066-d7699fe9c3dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:30.129353 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-02a26478-e95a-4013-8066-d7699fe9c3dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:30.129811 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-02a26478-e95a-4013-8066-d7699fe9c3dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:30.130231 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-02a26478-e95a-4013-8066-d7699fe9c3dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:30.260693 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-02a26478-e95a-4013-8066-d7699fe9c3dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:30.269853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-02a26478-e95a-4013-8066-d7699fe9c3dd tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1319 microversion: 2.1 time: 0.152690 Sep 26 18:13:30.270026 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 490/964] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:30 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:31.293735 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a51c75e3-39a2-4828-b157-5f23c9d0b320 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:31.294345 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a51c75e3-39a2-4828-b157-5f23c9d0b320 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:31.300685 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a51c75e3-39a2-4828-b157-5f23c9d0b320 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:31.301171 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a51c75e3-39a2-4828-b157-5f23c9d0b320 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:31.301611 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a51c75e3-39a2-4828-b157-5f23c9d0b320 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:31.302300 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a51c75e3-39a2-4828-b157-5f23c9d0b320 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:31.302756 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a51c75e3-39a2-4828-b157-5f23c9d0b320 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:31.303178 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a51c75e3-39a2-4828-b157-5f23c9d0b320 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:31.462138 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a51c75e3-39a2-4828-b157-5f23c9d0b320 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:31.469875 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a51c75e3-39a2-4828-b157-5f23c9d0b320 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1319 microversion: 2.1 time: 0.180576 Sep 26 18:13:31.470450 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 475/965] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:31 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:32.190526 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-df0ffcf5-8857-493b-a06b-6571befd6a13 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:32.192942 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-df0ffcf5-8857-493b-a06b-6571befd6a13 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:32.199467 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-df0ffcf5-8857-493b-a06b-6571befd6a13 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:32.200008 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-df0ffcf5-8857-493b-a06b-6571befd6a13 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:32.200451 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-df0ffcf5-8857-493b-a06b-6571befd6a13 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:32.201166 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-df0ffcf5-8857-493b-a06b-6571befd6a13 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:32.201630 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-df0ffcf5-8857-493b-a06b-6571befd6a13 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:32.202060 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-df0ffcf5-8857-493b-a06b-6571befd6a13 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:32.232620 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-df0ffcf5-8857-493b-a06b-6571befd6a13 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046149 Sep 26 18:13:32.233089 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 491/966] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:13:32 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 18:13:32.304255 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-284a521c-f0d0-4431-ba02-d211ee70b9a6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:32.304785 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-284a521c-f0d0-4431-ba02-d211ee70b9a6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:32.311276 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-284a521c-f0d0-4431-ba02-d211ee70b9a6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:32.311809 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-284a521c-f0d0-4431-ba02-d211ee70b9a6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:32.312257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-284a521c-f0d0-4431-ba02-d211ee70b9a6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:32.312951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-284a521c-f0d0-4431-ba02-d211ee70b9a6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:32.313405 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-284a521c-f0d0-4431-ba02-d211ee70b9a6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:32.313830 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-284a521c-f0d0-4431-ba02-d211ee70b9a6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:32.339974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-284a521c-f0d0-4431-ba02-d211ee70b9a6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Going to try to terminate instance {{(pid=121028) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:13:32.495709 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d45b6c8c-a5b5-4dbd-88d9-9cadc26a1846 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:32.496269 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d45b6c8c-a5b5-4dbd-88d9-9cadc26a1846 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:32.502611 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d45b6c8c-a5b5-4dbd-88d9-9cadc26a1846 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:32.503508 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d45b6c8c-a5b5-4dbd-88d9-9cadc26a1846 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:32.504384 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d45b6c8c-a5b5-4dbd-88d9-9cadc26a1846 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:32.505104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d45b6c8c-a5b5-4dbd-88d9-9cadc26a1846 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:32.505570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d45b6c8c-a5b5-4dbd-88d9-9cadc26a1846 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:32.505998 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d45b6c8c-a5b5-4dbd-88d9-9cadc26a1846 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:32.675602 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d45b6c8c-a5b5-4dbd-88d9-9cadc26a1846 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:32.683873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d45b6c8c-a5b5-4dbd-88d9-9cadc26a1846 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1319 microversion: 2.1 time: 0.192935 Sep 26 18:13:32.684437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 492/967] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:32 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:13:32.712223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-284a521c-f0d0-4431-ba02-d211ee70b9a6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 204 len: 0 microversion: 2.1 time: 0.412185 Sep 26 18:13:32.712921 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 476/968] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:13:32 2022] DELETE /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:13:32.722780 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-883466b2-111a-4c21-a759-f6665d32ec30 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:32.723124 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-883466b2-111a-4c21-a759-f6665d32ec30 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:32.730045 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-883466b2-111a-4c21-a759-f6665d32ec30 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:32.730753 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-883466b2-111a-4c21-a759-f6665d32ec30 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:32.731384 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-883466b2-111a-4c21-a759-f6665d32ec30 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:32.732355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-883466b2-111a-4c21-a759-f6665d32ec30 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:32.732814 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-883466b2-111a-4c21-a759-f6665d32ec30 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:32.733240 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-883466b2-111a-4c21-a759-f6665d32ec30 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:32.872037 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-883466b2-111a-4c21-a759-f6665d32ec30 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:32.881758 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-883466b2-111a-4c21-a759-f6665d32ec30 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1675 microversion: 2.1 time: 0.164242 Sep 26 18:13:32.882523 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 493/969] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:32 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:33.715837 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2ffef374-c4d6-494a-aa89-351a4683436a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:33.716561 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2ffef374-c4d6-494a-aa89-351a4683436a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:33.718576 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=2 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:33.725001 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2ffef374-c4d6-494a-aa89-351a4683436a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:33.727093 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2ffef374-c4d6-494a-aa89-351a4683436a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:33.727093 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2ffef374-c4d6-494a-aa89-351a4683436a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:33.727093 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2ffef374-c4d6-494a-aa89-351a4683436a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:33.727585 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2ffef374-c4d6-494a-aa89-351a4683436a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:33.727859 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2ffef374-c4d6-494a-aa89-351a4683436a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:33.871833 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2ffef374-c4d6-494a-aa89-351a4683436a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:33.880097 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2ffef374-c4d6-494a-aa89-351a4683436a tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1319 microversion: 2.1 time: 0.168381 Sep 26 18:13:33.880826 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 477/970] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:33 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:33.905715 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-69c742b5-c361-4e9e-9a06-66330bca263a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:33.906333 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-69c742b5-c361-4e9e-9a06-66330bca263a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:33.908304 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:33.914659 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-69c742b5-c361-4e9e-9a06-66330bca263a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:33.915632 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-69c742b5-c361-4e9e-9a06-66330bca263a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:33.916530 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-69c742b5-c361-4e9e-9a06-66330bca263a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:33.917460 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-69c742b5-c361-4e9e-9a06-66330bca263a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:33.917927 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-69c742b5-c361-4e9e-9a06-66330bca263a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:33.918357 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-69c742b5-c361-4e9e-9a06-66330bca263a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:34.029480 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-1a5a69cb-a94c-4818-a9ec-e530a883d53a req-e23afd74-5db9-4b43-8c35-3c48b3d6d999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94bc578d-8428-4b87-99d5-003bdc0ba332", "name": "network-vif-plugged", "status": "completed", "tag": "4e8280a9-6d23-43f5-b7bd-ea29e328b808"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:13:34.044076 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-1a5a69cb-a94c-4818-a9ec-e530a883d53a req-e23afd74-5db9-4b43-8c35-3c48b3d6d999 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:34.044791 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-1a5a69cb-a94c-4818-a9ec-e530a883d53a req-e23afd74-5db9-4b43-8c35-3c48b3d6d999 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:34.045216 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-1a5a69cb-a94c-4818-a9ec-e530a883d53a req-e23afd74-5db9-4b43-8c35-3c48b3d6d999 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:34.059966 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-1a5a69cb-a94c-4818-a9ec-e530a883d53a req-e23afd74-5db9-4b43-8c35-3c48b3d6d999 service nova] Creating event network-vif-plugged:4e8280a9-6d23-43f5-b7bd-ea29e328b808 for instance 94bc578d-8428-4b87-99d5-003bdc0ba332 on hv-cinder-85931 Sep 26 18:13:34.103309 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-1a5a69cb-a94c-4818-a9ec-e530a883d53a req-e23afd74-5db9-4b43-8c35-3c48b3d6d999 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047881 Sep 26 18:13:34.103309 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 478/971] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:13:34.128116 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-69c742b5-c361-4e9e-9a06-66330bca263a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:34.136318 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-69c742b5-c361-4e9e-9a06-66330bca263a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1675 microversion: 2.1 time: 0.234543 Sep 26 18:13:34.136886 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 494/972] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:33 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1675 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:34.904973 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8328b2df-f839-42b3-bf6e-f98a0269243e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:34.906191 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-8328b2df-f839-42b3-bf6e-f98a0269243e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:34.915110 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8328b2df-f839-42b3-bf6e-f98a0269243e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:34.915817 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8328b2df-f839-42b3-bf6e-f98a0269243e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:34.916439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8328b2df-f839-42b3-bf6e-f98a0269243e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:34.917352 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8328b2df-f839-42b3-bf6e-f98a0269243e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:34.918006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8328b2df-f839-42b3-bf6e-f98a0269243e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:34.918633 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8328b2df-f839-42b3-bf6e-f98a0269243e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:35.162666 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-fddf18b2-e977-4354-bc6d-4ac089047fb0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:35.163317 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-fddf18b2-e977-4354-bc6d-4ac089047fb0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:35.165342 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=8 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:35.171135 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fddf18b2-e977-4354-bc6d-4ac089047fb0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:35.171641 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fddf18b2-e977-4354-bc6d-4ac089047fb0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:35.172110 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fddf18b2-e977-4354-bc6d-4ac089047fb0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:35.173042 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fddf18b2-e977-4354-bc6d-4ac089047fb0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:35.173691 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fddf18b2-e977-4354-bc6d-4ac089047fb0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:35.174138 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fddf18b2-e977-4354-bc6d-4ac089047fb0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:35.187797 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-8328b2df-f839-42b3-bf6e-f98a0269243e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:35.208189 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8328b2df-f839-42b3-bf6e-f98a0269243e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1319 microversion: 2.1 time: 0.307870 Sep 26 18:13:35.208789 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 479/973] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:34 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:35.435448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-fddf18b2-e977-4354-bc6d-4ac089047fb0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:35.445159 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-fddf18b2-e977-4354-bc6d-4ac089047fb0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1675 microversion: 2.1 time: 0.288098 Sep 26 18:13:35.446468 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 495/974] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:35 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1675 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:13:36.061195 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-67bf7b61-a62e-4609-98db-dda4acaa285d req-24f0457e-45b7-4fbe-b874-10f0cc44c7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7369614f-dc83-49a8-b16c-2c2189b1e9db", "name": "network-vif-deleted", "tag": "555a4990-c7e3-456c-b0c7-7742d6f81240"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:13:36.075504 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-67bf7b61-a62e-4609-98db-dda4acaa285d req-24f0457e-45b7-4fbe-b874-10f0cc44c7d9 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:36.076016 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-67bf7b61-a62e-4609-98db-dda4acaa285d req-24f0457e-45b7-4fbe-b874-10f0cc44c7d9 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:36.076451 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-67bf7b61-a62e-4609-98db-dda4acaa285d req-24f0457e-45b7-4fbe-b874-10f0cc44c7d9 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:36.089563 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-67bf7b61-a62e-4609-98db-dda4acaa285d req-24f0457e-45b7-4fbe-b874-10f0cc44c7d9 service nova] Creating event network-vif-deleted:555a4990-c7e3-456c-b0c7-7742d6f81240 for instance 7369614f-dc83-49a8-b16c-2c2189b1e9db on hv-cinder-85931 Sep 26 18:13:36.094973 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-67bf7b61-a62e-4609-98db-dda4acaa285d req-24f0457e-45b7-4fbe-b874-10f0cc44c7d9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037745 Sep 26 18:13:36.095969 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 480/975] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:13:36.234624 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7424db7d-4d45-40ab-ba02-ae9d858323fa tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:36.235161 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7424db7d-4d45-40ab-ba02-ae9d858323fa tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:36.243092 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7424db7d-4d45-40ab-ba02-ae9d858323fa tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:36.243837 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7424db7d-4d45-40ab-ba02-ae9d858323fa tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:36.244464 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7424db7d-4d45-40ab-ba02-ae9d858323fa tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:36.245171 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7424db7d-4d45-40ab-ba02-ae9d858323fa tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:36.245801 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7424db7d-4d45-40ab-ba02-ae9d858323fa tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:36.246324 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7424db7d-4d45-40ab-ba02-ae9d858323fa tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:36.412975 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-7424db7d-4d45-40ab-ba02-ae9d858323fa tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:36.420606 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7424db7d-4d45-40ab-ba02-ae9d858323fa tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1319 microversion: 2.1 time: 0.189923 Sep 26 18:13:36.421169 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 496/976] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:36 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:36.470815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b3a3754c-419a-48a5-9dc7-95d4f84989bd tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:36.471499 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b3a3754c-419a-48a5-9dc7-95d4f84989bd tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:36.479390 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b3a3754c-419a-48a5-9dc7-95d4f84989bd tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:36.480624 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b3a3754c-419a-48a5-9dc7-95d4f84989bd tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:36.481619 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b3a3754c-419a-48a5-9dc7-95d4f84989bd tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:36.482354 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b3a3754c-419a-48a5-9dc7-95d4f84989bd tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:36.483151 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b3a3754c-419a-48a5-9dc7-95d4f84989bd tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:36.483832 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b3a3754c-419a-48a5-9dc7-95d4f84989bd tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:36.561191 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b3a3754c-419a-48a5-9dc7-95d4f84989bd tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:36.571235 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b3a3754c-419a-48a5-9dc7-95d4f84989bd tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1607 microversion: 2.1 time: 0.104755 Sep 26 18:13:36.572538 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 481/977] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:36 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1607 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:37.445102 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-01f76524-4f6e-4225-bca5-8c5fd68a844e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:37.445720 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-01f76524-4f6e-4225-bca5-8c5fd68a844e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:37.452309 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-01f76524-4f6e-4225-bca5-8c5fd68a844e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:37.452801 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-01f76524-4f6e-4225-bca5-8c5fd68a844e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:37.453242 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-01f76524-4f6e-4225-bca5-8c5fd68a844e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:37.453934 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-01f76524-4f6e-4225-bca5-8c5fd68a844e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:37.454401 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-01f76524-4f6e-4225-bca5-8c5fd68a844e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:37.454832 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-01f76524-4f6e-4225-bca5-8c5fd68a844e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:37.599272 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1dcffe4f-4e14-4c69-a683-d5c774ef9f50 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:37.599973 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1dcffe4f-4e14-4c69-a683-d5c774ef9f50 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:37.607347 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1dcffe4f-4e14-4c69-a683-d5c774ef9f50 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:37.608062 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1dcffe4f-4e14-4c69-a683-d5c774ef9f50 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:37.608194 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-01f76524-4f6e-4225-bca5-8c5fd68a844e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:37.608644 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1dcffe4f-4e14-4c69-a683-d5c774ef9f50 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:37.609529 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1dcffe4f-4e14-4c69-a683-d5c774ef9f50 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:37.610010 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1dcffe4f-4e14-4c69-a683-d5c774ef9f50 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:37.610595 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1dcffe4f-4e14-4c69-a683-d5c774ef9f50 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:37.616407 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-01f76524-4f6e-4225-bca5-8c5fd68a844e tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1508 microversion: 2.1 time: 0.175186 Sep 26 18:13:37.616976 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 497/978] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:37 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:37.643942 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e9ea5130-e3a2-4f38-ba4c-c2551e5e508f tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0b71cb5-5027-43cb-86b9-00c85913cd0b", "device": "/dev/sdb"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:13:37.647560 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e9ea5130-e3a2-4f38-ba4c-c2551e5e508f tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:37.651295 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1dcffe4f-4e14-4c69-a683-d5c774ef9f50 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:37.652371 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1dcffe4f-4e14-4c69-a683-d5c774ef9f50 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:37.653002 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1dcffe4f-4e14-4c69-a683-d5c774ef9f50 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:37.654775 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-1dcffe4f-4e14-4c69-a683-d5c774ef9f50 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lazy-loading 'fault' on Instance uuid 7369614f-dc83-49a8-b16c-2c2189b1e9db {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:13:37.654925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e9ea5130-e3a2-4f38-ba4c-c2551e5e508f tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:37.655525 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e9ea5130-e3a2-4f38-ba4c-c2551e5e508f tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:37.656057 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e9ea5130-e3a2-4f38-ba4c-c2551e5e508f tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:37.656842 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e9ea5130-e3a2-4f38-ba4c-c2551e5e508f tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:37.657383 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e9ea5130-e3a2-4f38-ba4c-c2551e5e508f tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:37.660696 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e9ea5130-e3a2-4f38-ba4c-c2551e5e508f tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:37.726440 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1dcffe4f-4e14-4c69-a683-d5c774ef9f50 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:37.735532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1dcffe4f-4e14-4c69-a683-d5c774ef9f50 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 200 len: 1327 microversion: 2.1 time: 0.140565 Sep 26 18:13:37.736578 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 482/979] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:37 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 1327 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:38.619177 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e9ea5130-e3a2-4f38-ba4c-c2551e5e508f tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "POST /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.981745 Sep 26 18:13:38.619827 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 498/980] 10.222.0.67 () {60 vars in 1323 bytes} [Mon Sep 26 18:13:37 2022] POST /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332/os-volume_attachments => generated 194 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:13:38.778685 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4bda0f65-2d45-4c92-8942-c0e59e256fb8 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:38.778685 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4bda0f65-2d45-4c92-8942-c0e59e256fb8 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:38.779738 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4bda0f65-2d45-4c92-8942-c0e59e256fb8 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:38.780240 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4bda0f65-2d45-4c92-8942-c0e59e256fb8 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:38.780679 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4bda0f65-2d45-4c92-8942-c0e59e256fb8 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:38.781383 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4bda0f65-2d45-4c92-8942-c0e59e256fb8 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:38.782026 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4bda0f65-2d45-4c92-8942-c0e59e256fb8 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:38.782457 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4bda0f65-2d45-4c92-8942-c0e59e256fb8 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:38.796926 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-4bda0f65-2d45-4c92-8942-c0e59e256fb8 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] HTTP exception thrown: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4bda0f65-2d45-4c92-8942-c0e59e256fb8 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Request method failure captured: Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db HTTP/1.1 Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMersCjB96hhUUCuOXgeVD_Ya0yb8-4iI8cWD7nU9LkFp6Q4_oJwMnm_bbqwDG5pIG6Mk3C63LIrRPVEhn_4twwV90yqaTNLH3XmCOCHL6xyaSlMn_KYVhT5xugq0TKEunpwCbyOUNlbybCHAN89CYP8tngT2-nIy34rEtalpBmmuXh0 Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 7750acf9ab4843d1a3848472e99881a1 Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:13:38.801247 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:13:38.802974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:13:38.802974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:13:38.802974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 7750acf9ab4843d1a3848472e99881a1 Sep 26 18:13:38.802974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:13:38.802974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-AttachVolumeTestJSON-954633196-project Sep 26 18:13:38.802974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:13:38.802974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:13:38.802974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 4b1cdc37455c489fb45e1ce3e2421cc0 Sep 26 18:13:38.802974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-AttachVolumeTestJSON-954633196-project Sep 26 18:13:38.802974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:13:38.802974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. Sep 26 18:13:38.802974 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '7369614f-dc83-49a8-b16c-2c2189b1e9db'} Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:13:38.803995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. Sep 26 18:13:38.805993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:13:38.807497 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4bda0f65-2d45-4c92-8942-c0e59e256fb8 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Returning 404 to user: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:13:38.807497 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4bda0f65-2d45-4c92-8942-c0e59e256fb8 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 404 len: 111 microversion: 2.1 time: 0.034052 Sep 26 18:13:38.807497 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 483/981] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:38 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:13:38.810321 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-03cd335a-8d6d-4328-a5d4-3d622df0869c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '.version_select at 0x7f3a74796b80>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:38.815718 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR oslo.messaging._drivers.impl_rabbit [None req-03cd335a-8d6d-4328-a5d4-3d622df0869c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [9045f5b0-856a-494b-b738-73737c4b54cb] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 26 18:13:39.823373 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO oslo.messaging._drivers.impl_rabbit [None req-03cd335a-8d6d-4328-a5d4-3d622df0869c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [9045f5b0-856a-494b-b738-73737c4b54cb] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 49676. Sep 26 18:13:39.907697 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-03cd335a-8d6d-4328-a5d4-3d622df0869c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-218979986" status: 202 len: 0 microversion: 2.1 time: 1.101677 Sep 26 18:13:39.908297 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 499/982] 10.222.0.67 () {58 vars in 1218 bytes} [Mon Sep 26 18:13:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-218979986 => generated 0 bytes in 1103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:13:40.783852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3231306f-870a-483a-9314-100d5b195ddf tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Action: 'create', calling method: .version_select at 0x7f3a74a8d040>, body: {"keypair": {"name": "tempest-keypair-1594929119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb8+AoDrZ0VOKctIg0QUOaFNJxfX7zV/P/01YGG9rbMfwo0NzJLbGdWUED7F87EUqbOP5Bafr0vDhdW0fJoV0SfV5z1snfN399C2fB5aV6HI9xsK4qHDAhOEZGLzjiACA=="}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:13:40.802659 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-3231306f-870a-483a-9314-100d5b195ddf tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Getting quotas for project 7750acf9ab4843d1a3848472e99881a1. Resources: {'key_pairs'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:13:40.807461 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-3231306f-870a-483a-9314-100d5b195ddf tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Getting quotas for user 4b1cdc37455c489fb45e1ce3e2421cc0 and project 7750acf9ab4843d1a3848472e99881a1. Resources: {'key_pairs'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:13:40.913552 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-3231306f-870a-483a-9314-100d5b195ddf tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134120 Sep 26 18:13:40.914420 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 484/983] 10.222.0.67 () {60 vars in 1159 bytes} [Mon Sep 26 18:13:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:13:43.720683 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-888946631", "imageRef": "098970ac-a559-43ea-a8ef-9800fc13d69f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cfb449ba-f5c1-48f2-86e2-66ac0c50a443"}], "security_groups": [{"name": "tempest-securitygroup--356002468"}], "key_name": "tempest-keypair-1594929119", "user_data": "}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:13:43.825099 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.network.neutron [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] validate_networks() for [('cfb449ba-f5c1-48f2-86e2-66ac0c50a443', None, None, None, None, None)] {{(pid=121029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:13:44.204986 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Flavor limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:13:44.206203 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Image limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:13:44.206900 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Flavor pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:13:44.207348 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Image pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:13:44.207803 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:13:44.216610 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:44.217144 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:44.217567 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:44.218325 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:44.218839 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:44.219267 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:44.238049 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Getting quotas for project 7750acf9ab4843d1a3848472e99881a1. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:13:44.242097 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Getting quotas for user 4b1cdc37455c489fb45e1ce3e2421cc0 and project 7750acf9ab4843d1a3848472e99881a1. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:13:44.253002 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Going to run 1 instances... {{(pid=121029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:13:44.255366 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='098970ac-a559-43ea-a8ef-9800fc13d69f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:13:44.377660 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7bc37a22-81c6-4fa3-a6f0-409ae99a0486 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.661755 Sep 26 18:13:44.378322 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 500/984] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:13:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:13:44.389698 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-77f03951-6938-4bd8-90d4-1718c45a0406 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:44.390360 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-77f03951-6938-4bd8-90d4-1718c45a0406 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:44.446272 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-77f03951-6938-4bd8-90d4-1718c45a0406 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:44.453493 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-77f03951-6938-4bd8-90d4-1718c45a0406 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1237 microversion: 2.1 time: 0.067755 Sep 26 18:13:44.455346 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 485/985] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:44 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:13:45.477962 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-0edbe975-5776-43ba-890a-7b6a146451c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:45.478565 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-0edbe975-5776-43ba-890a-7b6a146451c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:45.484806 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0edbe975-5776-43ba-890a-7b6a146451c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:45.485289 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0edbe975-5776-43ba-890a-7b6a146451c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:45.485720 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0edbe975-5776-43ba-890a-7b6a146451c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:45.486447 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0edbe975-5776-43ba-890a-7b6a146451c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:45.486857 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0edbe975-5776-43ba-890a-7b6a146451c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:45.487478 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0edbe975-5776-43ba-890a-7b6a146451c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:45.551503 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-0edbe975-5776-43ba-890a-7b6a146451c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:45.559104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-0edbe975-5776-43ba-890a-7b6a146451c0 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1241 microversion: 2.1 time: 0.085652 Sep 26 18:13:45.559683 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 501/986] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:45 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:13:46.583233 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-484e9004-aa4d-4401-ba6c-ae14c9fa9f37 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:46.583883 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-484e9004-aa4d-4401-ba6c-ae14c9fa9f37 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:46.594169 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-484e9004-aa4d-4401-ba6c-ae14c9fa9f37 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:46.595101 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-484e9004-aa4d-4401-ba6c-ae14c9fa9f37 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:46.596468 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-484e9004-aa4d-4401-ba6c-ae14c9fa9f37 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:46.597759 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-484e9004-aa4d-4401-ba6c-ae14c9fa9f37 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:46.598626 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-484e9004-aa4d-4401-ba6c-ae14c9fa9f37 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:46.599414 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-484e9004-aa4d-4401-ba6c-ae14c9fa9f37 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:46.671454 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-484e9004-aa4d-4401-ba6c-ae14c9fa9f37 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:46.680450 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-484e9004-aa4d-4401-ba6c-ae14c9fa9f37 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1233 microversion: 2.1 time: 0.102144 Sep 26 18:13:46.680994 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 486/987] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:46 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1233 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:47.704818 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-22143129-da98-465a-818a-2b3d1c613e79 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:47.706047 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-22143129-da98-465a-818a-2b3d1c613e79 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:47.712657 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-22143129-da98-465a-818a-2b3d1c613e79 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:47.713152 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-22143129-da98-465a-818a-2b3d1c613e79 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:47.713588 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-22143129-da98-465a-818a-2b3d1c613e79 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:47.714315 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-22143129-da98-465a-818a-2b3d1c613e79 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:47.714774 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-22143129-da98-465a-818a-2b3d1c613e79 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:47.715216 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-22143129-da98-465a-818a-2b3d1c613e79 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:47.787790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-22143129-da98-465a-818a-2b3d1c613e79 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:47.795865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-22143129-da98-465a-818a-2b3d1c613e79 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1307 microversion: 2.1 time: 0.095251 Sep 26 18:13:47.796765 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 502/988] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:47 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:48.819861 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-25efad12-385c-4f47-835d-d233d15b51e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:48.820450 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-25efad12-385c-4f47-835d-d233d15b51e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:48.826925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-25efad12-385c-4f47-835d-d233d15b51e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:48.827409 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-25efad12-385c-4f47-835d-d233d15b51e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:48.827864 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-25efad12-385c-4f47-835d-d233d15b51e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:48.828547 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-25efad12-385c-4f47-835d-d233d15b51e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:48.829044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-25efad12-385c-4f47-835d-d233d15b51e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:48.829408 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-25efad12-385c-4f47-835d-d233d15b51e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:48.964123 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-25efad12-385c-4f47-835d-d233d15b51e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:48.973092 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-25efad12-385c-4f47-835d-d233d15b51e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1362 microversion: 2.1 time: 0.157024 Sep 26 18:13:48.973703 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 487/989] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:48 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:49.996542 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c4a8c0b6-4828-46b0-a589-d52eccf10568 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:49.997156 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c4a8c0b6-4828-46b0-a589-d52eccf10568 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:50.004114 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c4a8c0b6-4828-46b0-a589-d52eccf10568 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:50.004632 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c4a8c0b6-4828-46b0-a589-d52eccf10568 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:50.005065 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c4a8c0b6-4828-46b0-a589-d52eccf10568 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:50.005753 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c4a8c0b6-4828-46b0-a589-d52eccf10568 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:50.006211 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c4a8c0b6-4828-46b0-a589-d52eccf10568 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:50.006635 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c4a8c0b6-4828-46b0-a589-d52eccf10568 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:50.139459 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c4a8c0b6-4828-46b0-a589-d52eccf10568 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:50.148477 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c4a8c0b6-4828-46b0-a589-d52eccf10568 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1362 microversion: 2.1 time: 0.155868 Sep 26 18:13:50.149120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 503/990] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:49 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:51.171718 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c70d135f-63c7-435e-b81e-a5748d26bdd4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:51.172359 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c70d135f-63c7-435e-b81e-a5748d26bdd4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:51.182199 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c70d135f-63c7-435e-b81e-a5748d26bdd4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:51.182962 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c70d135f-63c7-435e-b81e-a5748d26bdd4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:51.183738 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c70d135f-63c7-435e-b81e-a5748d26bdd4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:51.184792 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c70d135f-63c7-435e-b81e-a5748d26bdd4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:51.185466 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c70d135f-63c7-435e-b81e-a5748d26bdd4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:51.186118 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c70d135f-63c7-435e-b81e-a5748d26bdd4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:51.374852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c70d135f-63c7-435e-b81e-a5748d26bdd4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:51.382553 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c70d135f-63c7-435e-b81e-a5748d26bdd4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1362 microversion: 2.1 time: 0.214823 Sep 26 18:13:51.383159 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 488/991] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:51 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:51.839788 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-c7524936-748c-4ae3-aaa4-1ff2be0cf33c req-ae5d2683-b084-414f-9f9e-3ade9557191f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a679ce86-f6fe-43f2-91ba-7910d805abfd", "tag": "35358136-74af-49bb-a78d-b31cb0a84ec0"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:13:51.850630 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-c7524936-748c-4ae3-aaa4-1ff2be0cf33c req-ae5d2683-b084-414f-9f9e-3ade9557191f service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:51.851146 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-c7524936-748c-4ae3-aaa4-1ff2be0cf33c req-ae5d2683-b084-414f-9f9e-3ade9557191f service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:51.851581 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-c7524936-748c-4ae3-aaa4-1ff2be0cf33c req-ae5d2683-b084-414f-9f9e-3ade9557191f service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:51.865342 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-c7524936-748c-4ae3-aaa4-1ff2be0cf33c req-ae5d2683-b084-414f-9f9e-3ade9557191f service nova] Creating event network-changed:35358136-74af-49bb-a78d-b31cb0a84ec0 for instance a679ce86-f6fe-43f2-91ba-7910d805abfd on hv-cinder-85931 Sep 26 18:13:51.871275 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-c7524936-748c-4ae3-aaa4-1ff2be0cf33c req-ae5d2683-b084-414f-9f9e-3ade9557191f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035110 Sep 26 18:13:51.871909 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 504/992] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:13:52.405097 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-316cf13c-7572-40b4-8560-a90ab448a1e4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:52.405704 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-316cf13c-7572-40b4-8560-a90ab448a1e4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:52.412653 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-316cf13c-7572-40b4-8560-a90ab448a1e4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:52.413392 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-316cf13c-7572-40b4-8560-a90ab448a1e4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:52.413668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-316cf13c-7572-40b4-8560-a90ab448a1e4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:52.414360 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-316cf13c-7572-40b4-8560-a90ab448a1e4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:52.414816 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-316cf13c-7572-40b4-8560-a90ab448a1e4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:52.415244 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-316cf13c-7572-40b4-8560-a90ab448a1e4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:52.636443 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-316cf13c-7572-40b4-8560-a90ab448a1e4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:52.645030 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-316cf13c-7572-40b4-8560-a90ab448a1e4 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1362 microversion: 2.1 time: 0.243433 Sep 26 18:13:52.648442 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 489/993] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:52 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:53.669647 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-fc91eb34-af96-40bf-b3f2-072d521bfd03 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:53.670285 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-fc91eb34-af96-40bf-b3f2-072d521bfd03 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:53.672611 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:53.678369 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fc91eb34-af96-40bf-b3f2-072d521bfd03 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:53.678865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fc91eb34-af96-40bf-b3f2-072d521bfd03 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:53.679335 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fc91eb34-af96-40bf-b3f2-072d521bfd03 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:53.680077 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fc91eb34-af96-40bf-b3f2-072d521bfd03 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:53.680560 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fc91eb34-af96-40bf-b3f2-072d521bfd03 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:53.681272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fc91eb34-af96-40bf-b3f2-072d521bfd03 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:53.685451 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:53.841842 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-fc91eb34-af96-40bf-b3f2-072d521bfd03 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:53.849609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-fc91eb34-af96-40bf-b3f2-072d521bfd03 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1362 microversion: 2.1 time: 0.184819 Sep 26 18:13:53.850179 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 505/994] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:53 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:54.873480 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a4cd832d-26ce-4b3d-bd41-f9bbbe78679d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:54.874076 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a4cd832d-26ce-4b3d-bd41-f9bbbe78679d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:54.877422 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=6 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:54.882292 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a4cd832d-26ce-4b3d-bd41-f9bbbe78679d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:54.885949 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a4cd832d-26ce-4b3d-bd41-f9bbbe78679d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:54.885949 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a4cd832d-26ce-4b3d-bd41-f9bbbe78679d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:54.885949 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a4cd832d-26ce-4b3d-bd41-f9bbbe78679d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:54.885949 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a4cd832d-26ce-4b3d-bd41-f9bbbe78679d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:54.886339 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a4cd832d-26ce-4b3d-bd41-f9bbbe78679d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:54.904937 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:55.055639 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a4cd832d-26ce-4b3d-bd41-f9bbbe78679d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:55.063241 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a4cd832d-26ce-4b3d-bd41-f9bbbe78679d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1362 microversion: 2.1 time: 0.194121 Sep 26 18:13:55.063828 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 490/995] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:54 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:56.086998 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-31c5d69d-9a8f-406c-a5db-86314c14d466 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:56.087618 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-31c5d69d-9a8f-406c-a5db-86314c14d466 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:56.094932 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:56.095795 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=6 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:56.101389 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-31c5d69d-9a8f-406c-a5db-86314c14d466 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:56.102119 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-31c5d69d-9a8f-406c-a5db-86314c14d466 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:56.102743 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-31c5d69d-9a8f-406c-a5db-86314c14d466 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:56.103749 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-31c5d69d-9a8f-406c-a5db-86314c14d466 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:56.104373 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-31c5d69d-9a8f-406c-a5db-86314c14d466 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:56.112745 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-31c5d69d-9a8f-406c-a5db-86314c14d466 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:56.312642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-31c5d69d-9a8f-406c-a5db-86314c14d466 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:56.321701 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-31c5d69d-9a8f-406c-a5db-86314c14d466 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1362 microversion: 2.1 time: 0.239715 Sep 26 18:13:56.322271 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 506/996] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:56 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:13:57.347993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e2ce4117-2ca3-4990-8684-31d32bab1d1f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:57.348700 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e2ce4117-2ca3-4990-8684-31d32bab1d1f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:57.350932 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:13:57.356358 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e2ce4117-2ca3-4990-8684-31d32bab1d1f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:57.356848 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e2ce4117-2ca3-4990-8684-31d32bab1d1f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:57.357285 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e2ce4117-2ca3-4990-8684-31d32bab1d1f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:57.357985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e2ce4117-2ca3-4990-8684-31d32bab1d1f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:57.358439 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e2ce4117-2ca3-4990-8684-31d32bab1d1f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:57.359114 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e2ce4117-2ca3-4990-8684-31d32bab1d1f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:57.542940 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e2ce4117-2ca3-4990-8684-31d32bab1d1f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:57.547951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e2ce4117-2ca3-4990-8684-31d32bab1d1f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1362 microversion: 2.1 time: 0.205245 Sep 26 18:13:57.548561 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 491/997] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:57 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:13:58.576133 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-70991e28-d16a-4b87-9a18-645d908eee02 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:58.576937 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-70991e28-d16a-4b87-9a18-645d908eee02 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:58.585780 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-70991e28-d16a-4b87-9a18-645d908eee02 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:58.586557 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-70991e28-d16a-4b87-9a18-645d908eee02 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:58.586998 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-70991e28-d16a-4b87-9a18-645d908eee02 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:58.587998 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-70991e28-d16a-4b87-9a18-645d908eee02 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:58.588482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-70991e28-d16a-4b87-9a18-645d908eee02 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:58.589156 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-70991e28-d16a-4b87-9a18-645d908eee02 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:58.778871 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-70991e28-d16a-4b87-9a18-645d908eee02 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:58.787947 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-70991e28-d16a-4b87-9a18-645d908eee02 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1362 microversion: 2.1 time: 0.219278 Sep 26 18:13:58.788649 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 507/998] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:58 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:13:59.811805 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3fb6875f-d4b7-47e9-93fc-5f0c59da4be9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:59.812417 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-3fb6875f-d4b7-47e9-93fc-5f0c59da4be9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:59.821381 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3fb6875f-d4b7-47e9-93fc-5f0c59da4be9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:59.821889 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3fb6875f-d4b7-47e9-93fc-5f0c59da4be9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:59.822327 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3fb6875f-d4b7-47e9-93fc-5f0c59da4be9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:59.823035 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3fb6875f-d4b7-47e9-93fc-5f0c59da4be9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:59.823694 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3fb6875f-d4b7-47e9-93fc-5f0c59da4be9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:59.824481 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-3fb6875f-d4b7-47e9-93fc-5f0c59da4be9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:59.888884 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-95580b39-0567-4a60-8127-789f0240f7de tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:13:59.889979 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-95580b39-0567-4a60-8127-789f0240f7de tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:13:59.898984 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95580b39-0567-4a60-8127-789f0240f7de tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:59.899806 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95580b39-0567-4a60-8127-789f0240f7de tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:59.900589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95580b39-0567-4a60-8127-789f0240f7de tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:59.902116 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95580b39-0567-4a60-8127-789f0240f7de tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:13:59.902755 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95580b39-0567-4a60-8127-789f0240f7de tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:13:59.903181 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-95580b39-0567-4a60-8127-789f0240f7de tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:13:59.982666 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-3fb6875f-d4b7-47e9-93fc-5f0c59da4be9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:13:59.991359 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-3fb6875f-d4b7-47e9-93fc-5f0c59da4be9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1362 microversion: 2.1 time: 0.183605 Sep 26 18:13:59.993440 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 492/999] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:13:59 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:00.042757 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-95580b39-0567-4a60-8127-789f0240f7de tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lazy-loading 'services' on Instance uuid 94bc578d-8428-4b87-99d5-003bdc0ba332 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:14:00.381235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-95580b39-0567-4a60-8127-789f0240f7de tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "DELETE /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332/os-volume_attachments/b0b71cb5-5027-43cb-86b9-00c85913cd0b" status: 202 len: 0 microversion: 2.1 time: 0.497807 Sep 26 18:14:00.386347 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 508/1000] 10.222.0.67 () {58 vars in 1416 bytes} [Mon Sep 26 18:13:59 2022] DELETE /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332/os-volume_attachments/b0b71cb5-5027-43cb-86b9-00c85913cd0b => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 18:14:00.910698 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-8de9615e-6123-4186-a46e-91b2a754ce7e req-f1523869-652a-46d0-ba5d-0715f20e11e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a679ce86-f6fe-43f2-91ba-7910d805abfd", "name": "network-vif-plugged", "status": "completed", "tag": "35358136-74af-49bb-a78d-b31cb0a84ec0"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:14:00.923019 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-8de9615e-6123-4186-a46e-91b2a754ce7e req-f1523869-652a-46d0-ba5d-0715f20e11e4 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:00.924260 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-8de9615e-6123-4186-a46e-91b2a754ce7e req-f1523869-652a-46d0-ba5d-0715f20e11e4 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:00.925237 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-8de9615e-6123-4186-a46e-91b2a754ce7e req-f1523869-652a-46d0-ba5d-0715f20e11e4 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:00.937702 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-8de9615e-6123-4186-a46e-91b2a754ce7e req-f1523869-652a-46d0-ba5d-0715f20e11e4 service nova] Creating event network-vif-plugged:35358136-74af-49bb-a78d-b31cb0a84ec0 for instance a679ce86-f6fe-43f2-91ba-7910d805abfd on hv-cinder-85931 Sep 26 18:14:00.944498 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-8de9615e-6123-4186-a46e-91b2a754ce7e req-f1523869-652a-46d0-ba5d-0715f20e11e4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039557 Sep 26 18:14:00.945098 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 493/1001] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:14:01.020402 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-6f773c2c-d27d-48b7-a95c-8a93985055b5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:01.021094 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-6f773c2c-d27d-48b7-a95c-8a93985055b5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:01.027573 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6f773c2c-d27d-48b7-a95c-8a93985055b5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:01.028080 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6f773c2c-d27d-48b7-a95c-8a93985055b5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:01.028513 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6f773c2c-d27d-48b7-a95c-8a93985055b5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:01.029251 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6f773c2c-d27d-48b7-a95c-8a93985055b5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:01.029671 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6f773c2c-d27d-48b7-a95c-8a93985055b5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:01.030098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6f773c2c-d27d-48b7-a95c-8a93985055b5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:01.207585 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-6f773c2c-d27d-48b7-a95c-8a93985055b5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:01.218027 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-6f773c2c-d27d-48b7-a95c-8a93985055b5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1362 microversion: 2.1 time: 0.200872 Sep 26 18:14:01.218027 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 509/1002] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:01 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:02.245528 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-47573d68-fe6f-45b3-9bd0-d994c6109828 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:02.247482 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-47573d68-fe6f-45b3-9bd0-d994c6109828 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:02.258208 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-47573d68-fe6f-45b3-9bd0-d994c6109828 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:02.261083 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-47573d68-fe6f-45b3-9bd0-d994c6109828 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:02.261083 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-47573d68-fe6f-45b3-9bd0-d994c6109828 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:02.261083 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-47573d68-fe6f-45b3-9bd0-d994c6109828 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:02.261083 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-47573d68-fe6f-45b3-9bd0-d994c6109828 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:02.261481 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-47573d68-fe6f-45b3-9bd0-d994c6109828 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:02.639600 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-3b8189fb-2efe-4b3c-acaa-0807d3ee297c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:02.640840 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3b8189fb-2efe-4b3c-acaa-0807d3ee297c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:02.650606 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3b8189fb-2efe-4b3c-acaa-0807d3ee297c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:02.651259 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3b8189fb-2efe-4b3c-acaa-0807d3ee297c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:02.652015 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3b8189fb-2efe-4b3c-acaa-0807d3ee297c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:02.653012 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3b8189fb-2efe-4b3c-acaa-0807d3ee297c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:02.653728 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3b8189fb-2efe-4b3c-acaa-0807d3ee297c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:02.654374 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3b8189fb-2efe-4b3c-acaa-0807d3ee297c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:02.687784 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3b8189fb-2efe-4b3c-acaa-0807d3ee297c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Going to try to terminate instance {{(pid=121029) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:14:02.933237 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-47573d68-fe6f-45b3-9bd0-d994c6109828 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:02.941922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-47573d68-fe6f-45b3-9bd0-d994c6109828 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1362 microversion: 2.1 time: 0.705320 Sep 26 18:14:02.960634 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 494/1003] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:02 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1362 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:03.031820 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-3b8189fb-2efe-4b3c-acaa-0807d3ee297c tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "DELETE /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 204 len: 0 microversion: 2.1 time: 0.396017 Sep 26 18:14:03.032451 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 510/1004] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:14:02 2022] DELETE /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:14:03.042821 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-5e1b75a0-af9a-45aa-92c4-66b0f51f0416 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:03.044424 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-5e1b75a0-af9a-45aa-92c4-66b0f51f0416 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:03.070433 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e1b75a0-af9a-45aa-92c4-66b0f51f0416 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:03.072315 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e1b75a0-af9a-45aa-92c4-66b0f51f0416 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:03.078527 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e1b75a0-af9a-45aa-92c4-66b0f51f0416 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:03.080757 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e1b75a0-af9a-45aa-92c4-66b0f51f0416 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:03.084838 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e1b75a0-af9a-45aa-92c4-66b0f51f0416 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:03.085407 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e1b75a0-af9a-45aa-92c4-66b0f51f0416 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:03.397647 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-5e1b75a0-af9a-45aa-92c4-66b0f51f0416 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:03.410198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-5e1b75a0-af9a-45aa-92c4-66b0f51f0416 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1514 microversion: 2.1 time: 0.371793 Sep 26 18:14:03.410793 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 495/1005] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:03 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1514 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:03.965805 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-3de780fc-0d61-4b70-bd43-268d7945ba8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:03.967263 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3de780fc-0d61-4b70-bd43-268d7945ba8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:03.974522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3de780fc-0d61-4b70-bd43-268d7945ba8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:03.975051 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3de780fc-0d61-4b70-bd43-268d7945ba8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:03.975485 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3de780fc-0d61-4b70-bd43-268d7945ba8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:03.976693 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3de780fc-0d61-4b70-bd43-268d7945ba8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:03.977324 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3de780fc-0d61-4b70-bd43-268d7945ba8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:03.977915 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3de780fc-0d61-4b70-bd43-268d7945ba8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:04.204553 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3de780fc-0d61-4b70-bd43-268d7945ba8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:04.215919 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-3de780fc-0d61-4b70-bd43-268d7945ba8e tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1549 microversion: 2.1 time: 0.254549 Sep 26 18:14:04.217079 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 511/1006] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:03 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1549 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:04.239605 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-92a13b23-c761-4e09-9369-f0222539ee2a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:04.240348 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-92a13b23-c761-4e09-9369-f0222539ee2a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:04.247332 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92a13b23-c761-4e09-9369-f0222539ee2a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:04.247853 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92a13b23-c761-4e09-9369-f0222539ee2a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:04.248279 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92a13b23-c761-4e09-9369-f0222539ee2a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:04.249154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92a13b23-c761-4e09-9369-f0222539ee2a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:04.249764 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92a13b23-c761-4e09-9369-f0222539ee2a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:04.250348 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92a13b23-c761-4e09-9369-f0222539ee2a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:04.389965 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-92a13b23-c761-4e09-9369-f0222539ee2a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.154381 Sep 26 18:14:04.403847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 496/1007] 10.222.0.67 () {58 vars in 1275 bytes} [Mon Sep 26 18:14:04 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-interface => generated 285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:14:04.433806 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-dbb68a15-9128-40e1-b1ff-81bce5f34bad tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:04.434721 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-dbb68a15-9128-40e1-b1ff-81bce5f34bad tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:04.447263 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dbb68a15-9128-40e1-b1ff-81bce5f34bad tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:04.448035 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dbb68a15-9128-40e1-b1ff-81bce5f34bad tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:04.448476 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dbb68a15-9128-40e1-b1ff-81bce5f34bad tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:04.449190 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dbb68a15-9128-40e1-b1ff-81bce5f34bad tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:04.449643 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dbb68a15-9128-40e1-b1ff-81bce5f34bad tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:04.450251 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-dbb68a15-9128-40e1-b1ff-81bce5f34bad tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:04.720371 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-dbb68a15-9128-40e1-b1ff-81bce5f34bad tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:04.729235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-dbb68a15-9128-40e1-b1ff-81bce5f34bad tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1514 microversion: 2.1 time: 0.299599 Sep 26 18:14:04.734858 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 512/1008] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:04 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1514 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:05.762608 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-5e4d3631-7b77-4e4d-9069-1584e5967987 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:05.763277 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-5e4d3631-7b77-4e4d-9069-1584e5967987 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:05.783804 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e4d3631-7b77-4e4d-9069-1584e5967987 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:05.784971 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e4d3631-7b77-4e4d-9069-1584e5967987 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:05.785419 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e4d3631-7b77-4e4d-9069-1584e5967987 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:05.786130 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e4d3631-7b77-4e4d-9069-1584e5967987 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:05.786659 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e4d3631-7b77-4e4d-9069-1584e5967987 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:05.787089 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5e4d3631-7b77-4e4d-9069-1584e5967987 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:05.788230 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-74bfef78-f9a0-44cf-875e-5a76b70e088f req-06172a6f-8ec2-42a7-ae39-2e9dece78b82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a679ce86-f6fe-43f2-91ba-7910d805abfd", "tag": "35358136-74af-49bb-a78d-b31cb0a84ec0"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:14:05.810315 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-74bfef78-f9a0-44cf-875e-5a76b70e088f req-06172a6f-8ec2-42a7-ae39-2e9dece78b82 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:05.811182 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-74bfef78-f9a0-44cf-875e-5a76b70e088f req-06172a6f-8ec2-42a7-ae39-2e9dece78b82 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:05.812236 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-74bfef78-f9a0-44cf-875e-5a76b70e088f req-06172a6f-8ec2-42a7-ae39-2e9dece78b82 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:05.842613 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-74bfef78-f9a0-44cf-875e-5a76b70e088f req-06172a6f-8ec2-42a7-ae39-2e9dece78b82 service nova] Creating event network-changed:35358136-74af-49bb-a78d-b31cb0a84ec0 for instance a679ce86-f6fe-43f2-91ba-7910d805abfd on hv-cinder-85931 Sep 26 18:14:05.848277 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-74bfef78-f9a0-44cf-875e-5a76b70e088f req-06172a6f-8ec2-42a7-ae39-2e9dece78b82 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066390 Sep 26 18:14:05.850260 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 513/1009] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:14:06.229944 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-5e4d3631-7b77-4e4d-9069-1584e5967987 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:06.240894 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-5e4d3631-7b77-4e4d-9069-1584e5967987 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1514 microversion: 2.1 time: 0.483078 Sep 26 18:14:06.259496 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 497/1010] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:05 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1514 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:06.289687 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-6eeda5f3-d157-4843-ae2c-f8dc45ae573a req-43a5f4c6-5cdb-417a-81e4-5d0da27e4a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94bc578d-8428-4b87-99d5-003bdc0ba332", "name": "network-vif-deleted", "tag": "4e8280a9-6d23-43f5-b7bd-ea29e328b808"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:14:06.306221 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-6eeda5f3-d157-4843-ae2c-f8dc45ae573a req-43a5f4c6-5cdb-417a-81e4-5d0da27e4a85 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:06.307326 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-6eeda5f3-d157-4843-ae2c-f8dc45ae573a req-43a5f4c6-5cdb-417a-81e4-5d0da27e4a85 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:06.308025 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-6eeda5f3-d157-4843-ae2c-f8dc45ae573a req-43a5f4c6-5cdb-417a-81e4-5d0da27e4a85 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:06.326279 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-6eeda5f3-d157-4843-ae2c-f8dc45ae573a req-43a5f4c6-5cdb-417a-81e4-5d0da27e4a85 service nova] Creating event network-vif-deleted:4e8280a9-6d23-43f5-b7bd-ea29e328b808 for instance 94bc578d-8428-4b87-99d5-003bdc0ba332 on hv-cinder-85931 Sep 26 18:14:06.335385 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-6eeda5f3-d157-4843-ae2c-f8dc45ae573a req-43a5f4c6-5cdb-417a-81e4-5d0da27e4a85 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053176 Sep 26 18:14:06.337230 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 514/1011] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:14:07.284044 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6d0593bf-ee2e-4842-9017-f7d5c3e7b233 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:07.284682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-6d0593bf-ee2e-4842-9017-f7d5c3e7b233 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:07.295864 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d0593bf-ee2e-4842-9017-f7d5c3e7b233 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:07.298587 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d0593bf-ee2e-4842-9017-f7d5c3e7b233 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:07.299373 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d0593bf-ee2e-4842-9017-f7d5c3e7b233 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:07.300893 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d0593bf-ee2e-4842-9017-f7d5c3e7b233 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:07.302699 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d0593bf-ee2e-4842-9017-f7d5c3e7b233 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:07.303963 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d0593bf-ee2e-4842-9017-f7d5c3e7b233 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:07.367007 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d0593bf-ee2e-4842-9017-f7d5c3e7b233 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:07.367789 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d0593bf-ee2e-4842-9017-f7d5c3e7b233 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:07.368394 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6d0593bf-ee2e-4842-9017-f7d5c3e7b233 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:07.369367 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-6d0593bf-ee2e-4842-9017-f7d5c3e7b233 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lazy-loading 'fault' on Instance uuid 94bc578d-8428-4b87-99d5-003bdc0ba332 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:14:07.446320 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6d0593bf-ee2e-4842-9017-f7d5c3e7b233 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf12b3f54e349d5a8f6587410c79501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518090209d9a462fbf40d6cb86c3c695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:07.459909 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-6d0593bf-ee2e-4842-9017-f7d5c3e7b233 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 200 len: 1309 microversion: 2.1 time: 0.191809 Sep 26 18:14:07.461261 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 498/1012] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:07 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 1309 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:08.494455 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f8e21e5a-3ef3-4594-837c-7bb20437ffa1 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:08.498220 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f8e21e5a-3ef3-4594-837c-7bb20437ffa1 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] [instance: 94bc578d-8428-4b87-99d5-003bdc0ba332] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:08.505849 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8e21e5a-3ef3-4594-837c-7bb20437ffa1 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:08.506556 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8e21e5a-3ef3-4594-837c-7bb20437ffa1 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:08.506834 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8e21e5a-3ef3-4594-837c-7bb20437ffa1 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:08.507861 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8e21e5a-3ef3-4594-837c-7bb20437ffa1 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:08.508332 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8e21e5a-3ef3-4594-837c-7bb20437ffa1 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:08.508762 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f8e21e5a-3ef3-4594-837c-7bb20437ffa1 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:08.524650 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-f8e21e5a-3ef3-4594-837c-7bb20437ffa1 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] HTTP exception thrown: Instance 94bc578d-8428-4b87-99d5-003bdc0ba332 could not be found. Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f8e21e5a-3ef3-4594-837c-7bb20437ffa1 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Request method failure captured: Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 HTTP/1.1 Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMetxczBzPtDEtjvlcFkCCAnCEWs9wl7AYNi3azV7X5GsUGBv49XV5Ka--Si1lVXFokHaIEO6BaIpmMsTePOMN7niUiceXZnbBXitwOZzhsEiDWxa3vJZU8tXtg8qbWUwPQL-WroQQxqL5zITeJx-DvlLgzVRcWyCG1NSHN-oCyd1yTM Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: 518090209d9a462fbf40d6cb86c3c695 Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-VolumesSnapshotTestJSON-471786393 Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:14:08.526772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:14:08.528337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/518090209d9a462fbf40d6cb86c3c695"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/518090209d9a462fbf40d6cb86c3c695"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_518090209d9a462fbf40d6cb86c3c695"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/518090209d9a462fbf40d6cb86c3c695"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:14:08.528337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-VolumesSnapshotTestJSON-471786393 Sep 26 18:14:08.528337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: 518090209d9a462fbf40d6cb86c3c695 Sep 26 18:14:08.528337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-471786393 Sep 26 18:14:08.528337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-VolumesSnapshotTestJSON-471786393-project Sep 26 18:14:08.528337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:14:08.528337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:14:08.528337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: ecf12b3f54e349d5a8f6587410c79501 Sep 26 18:14:08.528337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-VolumesSnapshotTestJSON-471786393-project Sep 26 18:14:08.528337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:14:08.528337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance 94bc578d-8428-4b87-99d5-003bdc0ba332 could not be found. Sep 26 18:14:08.528337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': '94bc578d-8428-4b87-99d5-003bdc0ba332'} Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94bc578d-8428-4b87-99d5-003bdc0ba332 could not be found. Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:14:08.529140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94bc578d-8428-4b87-99d5-003bdc0ba332 could not be found. Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94bc578d-8428-4b87-99d5-003bdc0ba332 could not be found. Sep 26 18:14:08.530450 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:14:08.533512 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f8e21e5a-3ef3-4594-837c-7bb20437ffa1 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] Returning 404 to user: Instance 94bc578d-8428-4b87-99d5-003bdc0ba332 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:14:08.534697 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f8e21e5a-3ef3-4594-837c-7bb20437ffa1 tempest-VolumesSnapshotTestJSON-471786393 tempest-VolumesSnapshotTestJSON-471786393-project] 10.222.0.67 "GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332" status: 404 len: 111 microversion: 2.1 time: 0.046113 Sep 26 18:14:08.538767 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 515/1013] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:08 2022] GET /compute/v2.1/servers/94bc578d-8428-4b87-99d5-003bdc0ba332 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:14:20.596274 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-3a0b663c-75c4-47cd-9e1d-ee7026808132 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Action: 'create', calling method: .version_select at 0x7f3a74b534c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-737834352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+F8M6uUFCeUUm2D5D1maebpI3/RHKzQU8tCl4KDeR0H8ftQ/JqKrd50ppc4ce2NqXi7qDfSrmLmBvPpD724iNiLy/UmS1qU8A/NRWqpR+NDTe8ffkl3pwiDCUrADJ7wg=="}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:14:20.602296 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=17 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:14:20.602980 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=46 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:14:20.615314 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-3a0b663c-75c4-47cd-9e1d-ee7026808132 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Getting quotas for project 3b1fa05de673407eae9d3b50898c7b04. Resources: {'key_pairs'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:14:20.619181 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-3a0b663c-75c4-47cd-9e1d-ee7026808132 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Getting quotas for user 97774c7b322e49339d0006640db34e07 and project 3b1fa05de673407eae9d3b50898c7b04. Resources: {'key_pairs'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:14:20.747393 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-3a0b663c-75c4-47cd-9e1d-ee7026808132 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.155081 Sep 26 18:14:20.747950 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 499/1014] 10.222.0.67 () {60 vars in 1159 bytes} [Mon Sep 26 18:14:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:14:20.798752 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-666910804", "imageRef": "07f9d5ac-31aa-46ed-8d94-fc7ea56738ec", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-737834352", "networks": [{"uuid": "22db2827-402e-4cac-b75e-19e5cab992bc"}]}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:14:20.808175 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:14:20.809026 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:14:20.855432 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.network.neutron [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] validate_networks() for [('22db2827-402e-4cac-b75e-19e5cab992bc', None, None, None, None, None)] {{(pid=121029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:14:21.256655 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Flavor limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:14:21.257209 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Image limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:14:21.257713 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Flavor pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:14:21.258144 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Image pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:14:21.258562 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:14:21.267284 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:21.267934 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:21.268376 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:21.269101 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:21.269561 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:21.269987 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:21.288193 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Getting quotas for project 3b1fa05de673407eae9d3b50898c7b04. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:14:21.292266 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Getting quotas for user 97774c7b322e49339d0006640db34e07 and project 3b1fa05de673407eae9d3b50898c7b04. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:14:21.304112 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Going to run 1 instances... {{(pid=121029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:14:21.306369 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07f9d5ac-31aa-46ed-8d94-fc7ea56738ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:14:21.474463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-6c57dc6e-7b31-4529-9089-1e44b1ea367e tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680187 Sep 26 18:14:21.475157 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 516/1015] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:14:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:14:21.488769 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2807a5f9-80da-49f2-a073-8c54b17580e4 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:21.490244 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2807a5f9-80da-49f2-a073-8c54b17580e4 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:21.546357 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2807a5f9-80da-49f2-a073-8c54b17580e4 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:21.553907 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2807a5f9-80da-49f2-a073-8c54b17580e4 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1257 microversion: 2.1 time: 0.071233 Sep 26 18:14:21.554369 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 500/1016] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:21 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:22.577001 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-4f456a8e-c729-47ce-8c9b-344db16ed6f6 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:22.577539 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-4f456a8e-c729-47ce-8c9b-344db16ed6f6 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:22.633040 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-4f456a8e-c729-47ce-8c9b-344db16ed6f6 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:22.640024 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-4f456a8e-c729-47ce-8c9b-344db16ed6f6 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1257 microversion: 2.1 time: 0.067438 Sep 26 18:14:22.640599 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 517/1017] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:22 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:23.663826 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-7dc236fa-05b8-4eda-a29c-41b6942594b8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:23.664440 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-7dc236fa-05b8-4eda-a29c-41b6942594b8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:23.671593 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7dc236fa-05b8-4eda-a29c-41b6942594b8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:23.672104 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7dc236fa-05b8-4eda-a29c-41b6942594b8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:23.672542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7dc236fa-05b8-4eda-a29c-41b6942594b8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:23.673920 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7dc236fa-05b8-4eda-a29c-41b6942594b8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:23.674382 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7dc236fa-05b8-4eda-a29c-41b6942594b8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:23.674809 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7dc236fa-05b8-4eda-a29c-41b6942594b8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:23.737638 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-7dc236fa-05b8-4eda-a29c-41b6942594b8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:23.745233 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-7dc236fa-05b8-4eda-a29c-41b6942594b8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1261 microversion: 2.1 time: 0.085319 Sep 26 18:14:23.745796 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 501/1018] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:23 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:24.769106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8597ae61-6828-4a93-b09c-bb904e0ffccf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:24.769779 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-8597ae61-6828-4a93-b09c-bb904e0ffccf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:24.776984 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8597ae61-6828-4a93-b09c-bb904e0ffccf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:24.777480 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8597ae61-6828-4a93-b09c-bb904e0ffccf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:24.777949 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8597ae61-6828-4a93-b09c-bb904e0ffccf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:24.778615 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8597ae61-6828-4a93-b09c-bb904e0ffccf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:24.779074 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8597ae61-6828-4a93-b09c-bb904e0ffccf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:24.779502 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8597ae61-6828-4a93-b09c-bb904e0ffccf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:24.857555 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-8597ae61-6828-4a93-b09c-bb904e0ffccf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:24.866552 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-8597ae61-6828-4a93-b09c-bb904e0ffccf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1253 microversion: 2.1 time: 0.101516 Sep 26 18:14:24.867503 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 518/1019] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:24 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1253 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:25.890595 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-bd94ef4c-334d-42c1-95a6-b35147cb4106 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:25.891216 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-bd94ef4c-334d-42c1-95a6-b35147cb4106 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:25.898728 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd94ef4c-334d-42c1-95a6-b35147cb4106 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:25.901738 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd94ef4c-334d-42c1-95a6-b35147cb4106 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:25.901738 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd94ef4c-334d-42c1-95a6-b35147cb4106 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:25.901738 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd94ef4c-334d-42c1-95a6-b35147cb4106 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:25.901738 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd94ef4c-334d-42c1-95a6-b35147cb4106 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:25.902134 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bd94ef4c-334d-42c1-95a6-b35147cb4106 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:25.987941 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-bd94ef4c-334d-42c1-95a6-b35147cb4106 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:26.000410 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-bd94ef4c-334d-42c1-95a6-b35147cb4106 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1317 microversion: 2.1 time: 0.112942 Sep 26 18:14:26.009650 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 502/1020] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:25 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1317 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:27.043461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1cde9f7f-2d2f-4536-a958-663bcc5883cc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:27.045797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1cde9f7f-2d2f-4536-a958-663bcc5883cc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:27.054058 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1cde9f7f-2d2f-4536-a958-663bcc5883cc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:27.055110 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1cde9f7f-2d2f-4536-a958-663bcc5883cc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:27.056305 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1cde9f7f-2d2f-4536-a958-663bcc5883cc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:27.057984 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1cde9f7f-2d2f-4536-a958-663bcc5883cc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:27.058937 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1cde9f7f-2d2f-4536-a958-663bcc5883cc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:27.059432 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1cde9f7f-2d2f-4536-a958-663bcc5883cc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:27.233489 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1cde9f7f-2d2f-4536-a958-663bcc5883cc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:27.243355 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1cde9f7f-2d2f-4536-a958-663bcc5883cc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1357 microversion: 2.1 time: 0.207851 Sep 26 18:14:27.244223 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 519/1021] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:27 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:28.270389 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9f8aaba9-2074-420a-95f2-dfa84e16fc99 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:28.271013 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9f8aaba9-2074-420a-95f2-dfa84e16fc99 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:28.277927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9f8aaba9-2074-420a-95f2-dfa84e16fc99 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:28.278657 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9f8aaba9-2074-420a-95f2-dfa84e16fc99 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:28.279284 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9f8aaba9-2074-420a-95f2-dfa84e16fc99 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:28.280233 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9f8aaba9-2074-420a-95f2-dfa84e16fc99 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:28.280984 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9f8aaba9-2074-420a-95f2-dfa84e16fc99 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:28.281411 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9f8aaba9-2074-420a-95f2-dfa84e16fc99 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:28.434941 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9f8aaba9-2074-420a-95f2-dfa84e16fc99 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:28.444327 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9f8aaba9-2074-420a-95f2-dfa84e16fc99 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1357 microversion: 2.1 time: 0.178628 Sep 26 18:14:28.462434 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 503/1022] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:28 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:29.468582 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-31a8a92b-f832-4b60-aae8-9c7d14e7508f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:29.469373 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-31a8a92b-f832-4b60-aae8-9c7d14e7508f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:29.477790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-31a8a92b-f832-4b60-aae8-9c7d14e7508f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:29.477790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-31a8a92b-f832-4b60-aae8-9c7d14e7508f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:29.477790 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-31a8a92b-f832-4b60-aae8-9c7d14e7508f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:29.480458 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-31a8a92b-f832-4b60-aae8-9c7d14e7508f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:29.480458 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-31a8a92b-f832-4b60-aae8-9c7d14e7508f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:29.480458 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-31a8a92b-f832-4b60-aae8-9c7d14e7508f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:29.618035 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-31a8a92b-f832-4b60-aae8-9c7d14e7508f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:29.626582 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-31a8a92b-f832-4b60-aae8-9c7d14e7508f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1357 microversion: 2.1 time: 0.161950 Sep 26 18:14:29.636916 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 520/1023] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:29 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:30.651013 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-fa8e70c4-e158-48c8-8901-81c495145e3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:30.651979 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-fa8e70c4-e158-48c8-8901-81c495145e3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:30.659170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa8e70c4-e158-48c8-8901-81c495145e3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:30.659781 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa8e70c4-e158-48c8-8901-81c495145e3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:30.660287 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa8e70c4-e158-48c8-8901-81c495145e3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:30.661056 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa8e70c4-e158-48c8-8901-81c495145e3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:30.661600 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa8e70c4-e158-48c8-8901-81c495145e3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:30.662125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fa8e70c4-e158-48c8-8901-81c495145e3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:30.804832 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-fa8e70c4-e158-48c8-8901-81c495145e3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:30.812919 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-fa8e70c4-e158-48c8-8901-81c495145e3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1357 microversion: 2.1 time: 0.166135 Sep 26 18:14:30.813490 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 504/1024] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:30 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:31.841636 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-3a2f3e07-80e3-44bb-90af-c87db8d5470a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:31.842294 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3a2f3e07-80e3-44bb-90af-c87db8d5470a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:31.847887 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:14:31.853135 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3a2f3e07-80e3-44bb-90af-c87db8d5470a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:31.854854 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3a2f3e07-80e3-44bb-90af-c87db8d5470a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:31.855488 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3a2f3e07-80e3-44bb-90af-c87db8d5470a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:31.856308 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3a2f3e07-80e3-44bb-90af-c87db8d5470a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:31.856875 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3a2f3e07-80e3-44bb-90af-c87db8d5470a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:31.860268 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3a2f3e07-80e3-44bb-90af-c87db8d5470a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:32.013547 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3a2f3e07-80e3-44bb-90af-c87db8d5470a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:32.033844 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-3a2f3e07-80e3-44bb-90af-c87db8d5470a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1357 microversion: 2.1 time: 0.197934 Sep 26 18:14:32.051563 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 521/1025] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:31 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:33.061266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9cded923-308e-4551-8517-c14167ce79d5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:33.063045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9cded923-308e-4551-8517-c14167ce79d5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:33.065744 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=6 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:14:33.071719 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9cded923-308e-4551-8517-c14167ce79d5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:33.072745 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9cded923-308e-4551-8517-c14167ce79d5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:33.073420 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9cded923-308e-4551-8517-c14167ce79d5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:33.074400 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9cded923-308e-4551-8517-c14167ce79d5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:33.075108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9cded923-308e-4551-8517-c14167ce79d5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:33.076824 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9cded923-308e-4551-8517-c14167ce79d5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:33.276487 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9cded923-308e-4551-8517-c14167ce79d5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:33.276487 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9cded923-308e-4551-8517-c14167ce79d5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1357 microversion: 2.1 time: 0.174526 Sep 26 18:14:33.276487 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 505/1026] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:33 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:34.260844 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-4b9f3ce5-ee08-4068-9a88-45b061b509b1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:34.262530 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-4b9f3ce5-ee08-4068-9a88-45b061b509b1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:34.264774 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=8 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:14:34.271610 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b9f3ce5-ee08-4068-9a88-45b061b509b1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:34.272540 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b9f3ce5-ee08-4068-9a88-45b061b509b1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:34.273160 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b9f3ce5-ee08-4068-9a88-45b061b509b1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:34.274032 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b9f3ce5-ee08-4068-9a88-45b061b509b1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:34.274650 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b9f3ce5-ee08-4068-9a88-45b061b509b1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:34.275410 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4b9f3ce5-ee08-4068-9a88-45b061b509b1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:34.419329 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-4b9f3ce5-ee08-4068-9a88-45b061b509b1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:34.427840 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-4b9f3ce5-ee08-4068-9a88-45b061b509b1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1357 microversion: 2.1 time: 0.171456 Sep 26 18:14:34.450205 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 522/1027] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:34 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:35.452510 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-192e8074-60cc-4a2a-aabb-0f184f2cbb55 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:35.453874 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-192e8074-60cc-4a2a-aabb-0f184f2cbb55 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:35.461899 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-192e8074-60cc-4a2a-aabb-0f184f2cbb55 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:35.462518 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-192e8074-60cc-4a2a-aabb-0f184f2cbb55 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:35.463018 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-192e8074-60cc-4a2a-aabb-0f184f2cbb55 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:35.464002 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-192e8074-60cc-4a2a-aabb-0f184f2cbb55 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:35.464532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-192e8074-60cc-4a2a-aabb-0f184f2cbb55 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:35.465030 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-192e8074-60cc-4a2a-aabb-0f184f2cbb55 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:35.661708 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-192e8074-60cc-4a2a-aabb-0f184f2cbb55 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:35.669437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-192e8074-60cc-4a2a-aabb-0f184f2cbb55 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1357 microversion: 2.1 time: 0.220794 Sep 26 18:14:35.670052 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 506/1028] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:35 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:36.255349 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-02824291-7586-404d-bff0-6d560a478a7b req-8ff7f2f1-196e-4eb2-94f6-5ae067bf6081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ccf69cd-9bbd-4b64-8623-df51a323a2d5", "tag": "e409e6bd-1f85-4fc8-88ad-e2f42c1ac4f0"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:14:36.266389 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-02824291-7586-404d-bff0-6d560a478a7b req-8ff7f2f1-196e-4eb2-94f6-5ae067bf6081 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:36.266837 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-02824291-7586-404d-bff0-6d560a478a7b req-8ff7f2f1-196e-4eb2-94f6-5ae067bf6081 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:36.267299 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-02824291-7586-404d-bff0-6d560a478a7b req-8ff7f2f1-196e-4eb2-94f6-5ae067bf6081 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:36.279140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-02824291-7586-404d-bff0-6d560a478a7b req-8ff7f2f1-196e-4eb2-94f6-5ae067bf6081 service nova] Creating event network-changed:e409e6bd-1f85-4fc8-88ad-e2f42c1ac4f0 for instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 on hv-cinder-85931 Sep 26 18:14:36.286255 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-02824291-7586-404d-bff0-6d560a478a7b req-8ff7f2f1-196e-4eb2-94f6-5ae067bf6081 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155618 Sep 26 18:14:36.286866 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 523/1029] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:14:36.692009 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-147e0789-0b5d-4f77-83e0-158fda49c679 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:36.692615 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-147e0789-0b5d-4f77-83e0-158fda49c679 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:36.699159 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-147e0789-0b5d-4f77-83e0-158fda49c679 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:36.699694 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-147e0789-0b5d-4f77-83e0-158fda49c679 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:36.700127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-147e0789-0b5d-4f77-83e0-158fda49c679 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:36.700913 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-147e0789-0b5d-4f77-83e0-158fda49c679 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:36.701364 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-147e0789-0b5d-4f77-83e0-158fda49c679 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:36.701779 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-147e0789-0b5d-4f77-83e0-158fda49c679 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:36.844348 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-147e0789-0b5d-4f77-83e0-158fda49c679 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:36.852897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-147e0789-0b5d-4f77-83e0-158fda49c679 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1357 microversion: 2.1 time: 0.165075 Sep 26 18:14:36.853471 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 507/1030] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:36 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:14:37.876344 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9fd78653-65bd-4168-98b6-15420dafac39 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:37.878675 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9fd78653-65bd-4168-98b6-15420dafac39 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:37.884910 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9fd78653-65bd-4168-98b6-15420dafac39 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:37.885406 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9fd78653-65bd-4168-98b6-15420dafac39 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:37.885846 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9fd78653-65bd-4168-98b6-15420dafac39 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:37.886556 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9fd78653-65bd-4168-98b6-15420dafac39 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:37.887011 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9fd78653-65bd-4168-98b6-15420dafac39 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:37.887442 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9fd78653-65bd-4168-98b6-15420dafac39 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:38.418747 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9fd78653-65bd-4168-98b6-15420dafac39 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:38.426506 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9fd78653-65bd-4168-98b6-15420dafac39 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1357 microversion: 2.1 time: 0.554986 Sep 26 18:14:38.427059 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 524/1031] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:37 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1357 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:39.450375 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-771a1719-26e3-468b-b722-3bfe83459a5a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:39.451054 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-771a1719-26e3-468b-b722-3bfe83459a5a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:39.460552 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-771a1719-26e3-468b-b722-3bfe83459a5a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:39.461070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-771a1719-26e3-468b-b722-3bfe83459a5a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:39.461489 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-771a1719-26e3-468b-b722-3bfe83459a5a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:39.462211 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-771a1719-26e3-468b-b722-3bfe83459a5a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:39.462672 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-771a1719-26e3-468b-b722-3bfe83459a5a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:39.463098 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-771a1719-26e3-468b-b722-3bfe83459a5a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:39.604277 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-771a1719-26e3-468b-b722-3bfe83459a5a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:39.613052 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-771a1719-26e3-468b-b722-3bfe83459a5a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1357 microversion: 2.1 time: 0.166836 Sep 26 18:14:39.613767 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 508/1032] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:39 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:40.636024 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-1c924ed4-3958-4b7e-829f-cd23bcd4f5db tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:40.636644 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-1c924ed4-3958-4b7e-829f-cd23bcd4f5db tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:40.643185 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1c924ed4-3958-4b7e-829f-cd23bcd4f5db tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:40.643690 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1c924ed4-3958-4b7e-829f-cd23bcd4f5db tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:40.644126 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1c924ed4-3958-4b7e-829f-cd23bcd4f5db tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:40.644807 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1c924ed4-3958-4b7e-829f-cd23bcd4f5db tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:40.645258 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1c924ed4-3958-4b7e-829f-cd23bcd4f5db tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:40.645942 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-1c924ed4-3958-4b7e-829f-cd23bcd4f5db tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:40.773361 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-1c924ed4-3958-4b7e-829f-cd23bcd4f5db tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:40.780916 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-1c924ed4-3958-4b7e-829f-cd23bcd4f5db tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1357 microversion: 2.1 time: 0.148763 Sep 26 18:14:40.781471 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 525/1033] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:40 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:41.803953 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-cb3bb79a-f98f-4bce-8380-f8400d0e3dda tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:41.804634 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-cb3bb79a-f98f-4bce-8380-f8400d0e3dda tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:41.811017 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cb3bb79a-f98f-4bce-8380-f8400d0e3dda tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:41.811490 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cb3bb79a-f98f-4bce-8380-f8400d0e3dda tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:41.811951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cb3bb79a-f98f-4bce-8380-f8400d0e3dda tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:41.812627 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cb3bb79a-f98f-4bce-8380-f8400d0e3dda tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:41.813074 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cb3bb79a-f98f-4bce-8380-f8400d0e3dda tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:41.813488 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cb3bb79a-f98f-4bce-8380-f8400d0e3dda tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:41.944599 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-cb3bb79a-f98f-4bce-8380-f8400d0e3dda tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:41.952147 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-cb3bb79a-f98f-4bce-8380-f8400d0e3dda tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1357 microversion: 2.1 time: 0.152165 Sep 26 18:14:41.952708 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 509/1034] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:41 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:14:42.976719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-2b77c767-93fd-425d-9464-2c1a72b4728f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:42.977344 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-2b77c767-93fd-425d-9464-2c1a72b4728f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:42.984381 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2b77c767-93fd-425d-9464-2c1a72b4728f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:42.984872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2b77c767-93fd-425d-9464-2c1a72b4728f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:42.985308 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2b77c767-93fd-425d-9464-2c1a72b4728f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:42.986069 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2b77c767-93fd-425d-9464-2c1a72b4728f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:42.986642 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2b77c767-93fd-425d-9464-2c1a72b4728f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:42.987252 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2b77c767-93fd-425d-9464-2c1a72b4728f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:43.120432 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-2b77c767-93fd-425d-9464-2c1a72b4728f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:43.128885 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-2b77c767-93fd-425d-9464-2c1a72b4728f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1357 microversion: 2.1 time: 0.156036 Sep 26 18:14:43.129467 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 526/1035] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:42 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:14:43.351792 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-e3d41988-1cee-41b0-bde0-acdaab868117 req-56034293-332c-4b18-a29f-b9155c5ba525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ccf69cd-9bbd-4b64-8623-df51a323a2d5", "name": "network-vif-plugged", "status": "completed", "tag": "e409e6bd-1f85-4fc8-88ad-e2f42c1ac4f0"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:14:43.361498 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-e3d41988-1cee-41b0-bde0-acdaab868117 req-56034293-332c-4b18-a29f-b9155c5ba525 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:43.364821 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-e3d41988-1cee-41b0-bde0-acdaab868117 req-56034293-332c-4b18-a29f-b9155c5ba525 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:43.364821 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-e3d41988-1cee-41b0-bde0-acdaab868117 req-56034293-332c-4b18-a29f-b9155c5ba525 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:43.376469 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-e3d41988-1cee-41b0-bde0-acdaab868117 req-56034293-332c-4b18-a29f-b9155c5ba525 service nova] Creating event network-vif-plugged:e409e6bd-1f85-4fc8-88ad-e2f42c1ac4f0 for instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 on hv-cinder-85931 Sep 26 18:14:43.382082 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-e3d41988-1cee-41b0-bde0-acdaab868117 req-56034293-332c-4b18-a29f-b9155c5ba525 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215737 Sep 26 18:14:43.382725 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 510/1036] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:14:43.762471 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8f28c0c9-495f-4778-8528-d42c4289a8f5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:43.762940 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-8f28c0c9-495f-4778-8528-d42c4289a8f5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:43.769026 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8f28c0c9-495f-4778-8528-d42c4289a8f5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:43.769512 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8f28c0c9-495f-4778-8528-d42c4289a8f5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:43.769950 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8f28c0c9-495f-4778-8528-d42c4289a8f5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:43.770899 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8f28c0c9-495f-4778-8528-d42c4289a8f5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:43.771351 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8f28c0c9-495f-4778-8528-d42c4289a8f5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:43.771801 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8f28c0c9-495f-4778-8528-d42c4289a8f5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:43.796547 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-8f28c0c9-495f-4778-8528-d42c4289a8f5 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/ips" status: 200 len: 147 microversion: 2.1 time: 0.037989 Sep 26 18:14:43.797109 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 527/1037] 10.222.0.67 () {58 vars in 1248 bytes} [Mon Sep 26 18:14:43 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:14:44.153576 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-16425df7-f0a3-4237-bb0b-9d4124ce29dc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:44.154450 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-16425df7-f0a3-4237-bb0b-9d4124ce29dc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:44.161581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-16425df7-f0a3-4237-bb0b-9d4124ce29dc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:44.162062 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-16425df7-f0a3-4237-bb0b-9d4124ce29dc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:44.162492 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-16425df7-f0a3-4237-bb0b-9d4124ce29dc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:44.163221 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-16425df7-f0a3-4237-bb0b-9d4124ce29dc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:44.163691 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-16425df7-f0a3-4237-bb0b-9d4124ce29dc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:44.164117 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-16425df7-f0a3-4237-bb0b-9d4124ce29dc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:44.294940 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-16425df7-f0a3-4237-bb0b-9d4124ce29dc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:44.303086 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-16425df7-f0a3-4237-bb0b-9d4124ce29dc tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1357 microversion: 2.1 time: 0.153747 Sep 26 18:14:44.303668 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 511/1038] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:44 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:45.326337 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-6dfdbe1a-45de-480c-8237-d6f9207d2982 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:45.326980 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-6dfdbe1a-45de-480c-8237-d6f9207d2982 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:45.334147 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6dfdbe1a-45de-480c-8237-d6f9207d2982 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:45.334631 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6dfdbe1a-45de-480c-8237-d6f9207d2982 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:45.335070 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6dfdbe1a-45de-480c-8237-d6f9207d2982 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:45.335797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6dfdbe1a-45de-480c-8237-d6f9207d2982 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:45.336251 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6dfdbe1a-45de-480c-8237-d6f9207d2982 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:45.336671 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6dfdbe1a-45de-480c-8237-d6f9207d2982 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:45.477886 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9e9630fc-9e75-418d-8c39-78d175afb231 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b79556d4-d076-4e29-b1cd-7726412e4da4"}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:14:45.479767 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-6dfdbe1a-45de-480c-8237-d6f9207d2982 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:45.480400 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9e9630fc-9e75-418d-8c39-78d175afb231 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:45.486785 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9e9630fc-9e75-418d-8c39-78d175afb231 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:45.487233 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-6dfdbe1a-45de-480c-8237-d6f9207d2982 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1357 microversion: 2.1 time: 0.164783 Sep 26 18:14:45.487363 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9e9630fc-9e75-418d-8c39-78d175afb231 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:45.487721 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9e9630fc-9e75-418d-8c39-78d175afb231 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:45.488023 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 528/1039] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:45 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:45.492755 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9e9630fc-9e75-418d-8c39-78d175afb231 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:45.493254 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9e9630fc-9e75-418d-8c39-78d175afb231 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:45.493687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9e9630fc-9e75-418d-8c39-78d175afb231 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:46.343986 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9e9630fc-9e75-418d-8c39-78d175afb231 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "POST /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.869685 Sep 26 18:14:46.345925 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 512/1040] 10.222.0.67 () {60 vars in 1323 bytes} [Mon Sep 26 18:14:45 2022] POST /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments => generated 194 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:14:46.510256 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d2c687a1-2038-4e3c-8935-772d1ad1aef9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:46.510867 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d2c687a1-2038-4e3c-8935-772d1ad1aef9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:46.518209 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d2c687a1-2038-4e3c-8935-772d1ad1aef9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:46.518738 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d2c687a1-2038-4e3c-8935-772d1ad1aef9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:46.519182 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d2c687a1-2038-4e3c-8935-772d1ad1aef9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:46.519920 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d2c687a1-2038-4e3c-8935-772d1ad1aef9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:46.520649 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d2c687a1-2038-4e3c-8935-772d1ad1aef9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:46.521082 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d2c687a1-2038-4e3c-8935-772d1ad1aef9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:46.652719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d2c687a1-2038-4e3c-8935-772d1ad1aef9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:46.661279 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d2c687a1-2038-4e3c-8935-772d1ad1aef9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1546 microversion: 2.1 time: 0.154876 Sep 26 18:14:46.663727 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 529/1041] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:46 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:46.683754 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-cc61872e-0ca8-40ce-8812-aa56fc45d4f8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:46.685124 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-cc61872e-0ca8-40ce-8812-aa56fc45d4f8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:46.690692 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cc61872e-0ca8-40ce-8812-aa56fc45d4f8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:46.691174 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cc61872e-0ca8-40ce-8812-aa56fc45d4f8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:46.691671 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cc61872e-0ca8-40ce-8812-aa56fc45d4f8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:46.692372 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cc61872e-0ca8-40ce-8812-aa56fc45d4f8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:46.692832 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cc61872e-0ca8-40ce-8812-aa56fc45d4f8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:46.693262 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-cc61872e-0ca8-40ce-8812-aa56fc45d4f8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:46.823725 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-cc61872e-0ca8-40ce-8812-aa56fc45d4f8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:46.832280 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-cc61872e-0ca8-40ce-8812-aa56fc45d4f8 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1546 microversion: 2.1 time: 0.152863 Sep 26 18:14:46.834114 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 513/1042] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:46 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:46.854102 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b427ecf0-2dcf-4549-bbfd-b8a596b08504 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:46.858928 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b427ecf0-2dcf-4549-bbfd-b8a596b08504 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:46.862838 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b427ecf0-2dcf-4549-bbfd-b8a596b08504 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Searching by: {'deleted': False, 'project_id': '3b1fa05de673407eae9d3b50898c7b04'} {{(pid=121029) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 26 18:14:46.866371 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b427ecf0-2dcf-4549-bbfd-b8a596b08504 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:46.866860 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b427ecf0-2dcf-4549-bbfd-b8a596b08504 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:46.867297 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b427ecf0-2dcf-4549-bbfd-b8a596b08504 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:46.868057 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b427ecf0-2dcf-4549-bbfd-b8a596b08504 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:46.868537 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b427ecf0-2dcf-4549-bbfd-b8a596b08504 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:46.868983 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b427ecf0-2dcf-4549-bbfd-b8a596b08504 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:46.962008 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.multi_cell_list [None req-b427ecf0-2dcf-4549-bbfd-b8a596b08504 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121029) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 26 18:14:47.060835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b427ecf0-2dcf-4549-bbfd-b8a596b08504 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.210495 Sep 26 18:14:47.061461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 530/1043] 10.222.0.67 () {58 vars in 1125 bytes} [Mon Sep 26 18:14:46 2022] GET /compute/v2.1/servers => generated 342 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:14:47.074604 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f45e26cd-47f6-48e8-8fcf-1ac87c50fd85 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:47.075257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f45e26cd-47f6-48e8-8fcf-1ac87c50fd85 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:47.082018 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f45e26cd-47f6-48e8-8fcf-1ac87c50fd85 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:47.082494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f45e26cd-47f6-48e8-8fcf-1ac87c50fd85 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:47.082926 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f45e26cd-47f6-48e8-8fcf-1ac87c50fd85 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:47.083608 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f45e26cd-47f6-48e8-8fcf-1ac87c50fd85 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:47.084085 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f45e26cd-47f6-48e8-8fcf-1ac87c50fd85 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:47.084504 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f45e26cd-47f6-48e8-8fcf-1ac87c50fd85 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:47.218546 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f45e26cd-47f6-48e8-8fcf-1ac87c50fd85 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:14:47.226610 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f45e26cd-47f6-48e8-8fcf-1ac87c50fd85 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1546 microversion: 2.1 time: 0.156190 Sep 26 18:14:47.227178 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 514/1044] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:14:47 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:14:49.172891 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-594287f8-7b79-40af-bdba-260909ae0c7c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02d0469d-33d8-479f-8757-c53dd81e37d3"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:14:49.176290 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-594287f8-7b79-40af-bdba-260909ae0c7c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:49.182744 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-594287f8-7b79-40af-bdba-260909ae0c7c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:49.185347 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-594287f8-7b79-40af-bdba-260909ae0c7c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:49.185347 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-594287f8-7b79-40af-bdba-260909ae0c7c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:49.185347 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-594287f8-7b79-40af-bdba-260909ae0c7c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:49.185347 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-594287f8-7b79-40af-bdba-260909ae0c7c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:49.185729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-594287f8-7b79-40af-bdba-260909ae0c7c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:49.891996 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-594287f8-7b79-40af-bdba-260909ae0c7c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "POST /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.723019 Sep 26 18:14:49.893181 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 531/1045] 10.222.0.67 () {60 vars in 1323 bytes} [Mon Sep 26 18:14:49 2022] POST /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments => generated 194 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:14:54.048779 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9ba37022-1b07-49b1-8bc1-651deb479b7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:54.051194 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9ba37022-1b07-49b1-8bc1-651deb479b7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:54.053813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:14:54.058586 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9ba37022-1b07-49b1-8bc1-651deb479b7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:54.059127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9ba37022-1b07-49b1-8bc1-651deb479b7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:54.059524 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9ba37022-1b07-49b1-8bc1-651deb479b7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:54.060261 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9ba37022-1b07-49b1-8bc1-651deb479b7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:54.060733 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9ba37022-1b07-49b1-8bc1-651deb479b7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:54.061158 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9ba37022-1b07-49b1-8bc1-651deb479b7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:54.064932 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:14:54.092911 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9ba37022-1b07-49b1-8bc1-651deb479b7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048092 Sep 26 18:14:54.093473 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 515/1046] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:14:54 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:14:54.105772 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-99465928-a125-4e5c-907d-e929e6a218fb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:14:54.106347 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-99465928-a125-4e5c-907d-e929e6a218fb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:54.108279 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:14:54.114010 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-99465928-a125-4e5c-907d-e929e6a218fb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:54.114494 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-99465928-a125-4e5c-907d-e929e6a218fb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:54.114925 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-99465928-a125-4e5c-907d-e929e6a218fb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:54.115613 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-99465928-a125-4e5c-907d-e929e6a218fb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:54.116102 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-99465928-a125-4e5c-907d-e929e6a218fb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:54.116521 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-99465928-a125-4e5c-907d-e929e6a218fb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:54.120108 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:14:54.147614 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-99465928-a125-4e5c-907d-e929e6a218fb tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments/b79556d4-d076-4e29-b1cd-7726412e4da4" status: 200 len: 194 microversion: 2.1 time: 0.046333 Sep 26 18:14:54.148262 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 532/1047] 10.222.0.67 () {58 vars in 1413 bytes} [Mon Sep 26 18:14:54 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments/b79556d4-d076-4e29-b1cd-7726412e4da4 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:14:55.854329 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c7d2ab11-a644-4923-be10-9d52070ce8e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed1841d1-41aa-4db8-b622-160312ee0bf2"}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:14:55.856713 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c7d2ab11-a644-4923-be10-9d52070ce8e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:14:55.864774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c7d2ab11-a644-4923-be10-9d52070ce8e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:55.875528 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c7d2ab11-a644-4923-be10-9d52070ce8e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:55.875528 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c7d2ab11-a644-4923-be10-9d52070ce8e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:55.875528 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c7d2ab11-a644-4923-be10-9d52070ce8e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:14:55.875528 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c7d2ab11-a644-4923-be10-9d52070ce8e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:14:55.875941 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c7d2ab11-a644-4923-be10-9d52070ce8e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:14:56.657829 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c7d2ab11-a644-4923-be10-9d52070ce8e9 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "POST /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.807887 Sep 26 18:14:56.658673 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 516/1048] 10.222.0.67 () {60 vars in 1323 bytes} [Mon Sep 26 18:14:55 2022] POST /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments => generated 194 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:15:01.737737 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b3b5804c-15d4-4f1f-b077-6832af6005ef tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:01.738348 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b3b5804c-15d4-4f1f-b077-6832af6005ef tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:01.740657 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:15:01.747139 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b3b5804c-15d4-4f1f-b077-6832af6005ef tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:01.747620 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b3b5804c-15d4-4f1f-b077-6832af6005ef tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:01.748078 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b3b5804c-15d4-4f1f-b077-6832af6005ef tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:01.748768 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b3b5804c-15d4-4f1f-b077-6832af6005ef tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:01.749229 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b3b5804c-15d4-4f1f-b077-6832af6005ef tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:01.749649 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b3b5804c-15d4-4f1f-b077-6832af6005ef tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:01.882562 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b3b5804c-15d4-4f1f-b077-6832af6005ef tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:01.891189 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b3b5804c-15d4-4f1f-b077-6832af6005ef tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1592 microversion: 2.1 time: 0.157983 Sep 26 18:15:01.891774 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 533/1049] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:01 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1592 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:03.919048 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-d4ea85d7-e722-4e5b-8a4c-5aaa578d296b req-b3211ec9-d8b2-4ebd-8203-da53ee3a8dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ccf69cd-9bbd-4b64-8623-df51a323a2d5", "tag": "e409e6bd-1f85-4fc8-88ad-e2f42c1ac4f0"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:15:03.930033 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-d4ea85d7-e722-4e5b-8a4c-5aaa578d296b req-b3211ec9-d8b2-4ebd-8203-da53ee3a8dc0 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:03.930527 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-d4ea85d7-e722-4e5b-8a4c-5aaa578d296b req-b3211ec9-d8b2-4ebd-8203-da53ee3a8dc0 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:03.931228 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-d4ea85d7-e722-4e5b-8a4c-5aaa578d296b req-b3211ec9-d8b2-4ebd-8203-da53ee3a8dc0 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:03.943238 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-d4ea85d7-e722-4e5b-8a4c-5aaa578d296b req-b3211ec9-d8b2-4ebd-8203-da53ee3a8dc0 service nova] Creating event network-changed:e409e6bd-1f85-4fc8-88ad-e2f42c1ac4f0 for instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 on hv-cinder-85931 Sep 26 18:15:03.948948 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-d4ea85d7-e722-4e5b-8a4c-5aaa578d296b req-b3211ec9-d8b2-4ebd-8203-da53ee3a8dc0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039530 Sep 26 18:15:03.949567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 517/1050] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:15:06.567058 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-6ca1d013-31e6-48d9-b777-4f9b772ef0ab tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-508849664"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:15:06.570205 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-6ca1d013-31e6-48d9-b777-4f9b772ef0ab tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:06.575793 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6ca1d013-31e6-48d9-b777-4f9b772ef0ab tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:06.576277 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6ca1d013-31e6-48d9-b777-4f9b772ef0ab tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:06.576754 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6ca1d013-31e6-48d9-b777-4f9b772ef0ab tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:06.577439 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6ca1d013-31e6-48d9-b777-4f9b772ef0ab tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:06.577890 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6ca1d013-31e6-48d9-b777-4f9b772ef0ab tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:06.578317 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6ca1d013-31e6-48d9-b777-4f9b772ef0ab tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:06.707958 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.network.security_group_api [None req-6ca1d013-31e6-48d9-b777-4f9b772ef0ab tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Adding security group fb4d97e8-fa11-4fa4-b8e3-9eed2b1ec4e6 to port e409e6bd-1f85-4fc8-88ad-e2f42c1ac4f0 Sep 26 18:15:07.097211 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-6ca1d013-31e6-48d9-b777-4f9b772ef0ab tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "POST /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/action" status: 202 len: 0 microversion: 2.1 time: 0.534404 Sep 26 18:15:07.098018 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 534/1051] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Sep 26 18:15:06 2022] POST /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:15:07.106305 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-58a06a02-5c6e-46c3-895e-0b22bde5e777 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:07.106994 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-58a06a02-5c6e-46c3-895e-0b22bde5e777 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:07.108066 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-46c6a21b-4e96-4e21-96d5-44579bf83876 req-626b337c-8c4c-4c81-8121-af468cec0b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ccf69cd-9bbd-4b64-8623-df51a323a2d5", "tag": "e409e6bd-1f85-4fc8-88ad-e2f42c1ac4f0"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:15:07.114086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-58a06a02-5c6e-46c3-895e-0b22bde5e777 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:07.114841 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-58a06a02-5c6e-46c3-895e-0b22bde5e777 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:07.115072 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-58a06a02-5c6e-46c3-895e-0b22bde5e777 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:07.115792 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-58a06a02-5c6e-46c3-895e-0b22bde5e777 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:07.116246 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-58a06a02-5c6e-46c3-895e-0b22bde5e777 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:07.116666 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-58a06a02-5c6e-46c3-895e-0b22bde5e777 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:07.118333 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-46c6a21b-4e96-4e21-96d5-44579bf83876 req-626b337c-8c4c-4c81-8121-af468cec0b77 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:07.119555 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-46c6a21b-4e96-4e21-96d5-44579bf83876 req-626b337c-8c4c-4c81-8121-af468cec0b77 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:07.123319 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-46c6a21b-4e96-4e21-96d5-44579bf83876 req-626b337c-8c4c-4c81-8121-af468cec0b77 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:07.137953 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-46c6a21b-4e96-4e21-96d5-44579bf83876 req-626b337c-8c4c-4c81-8121-af468cec0b77 service nova] Creating event network-changed:e409e6bd-1f85-4fc8-88ad-e2f42c1ac4f0 for instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 on hv-cinder-85931 Sep 26 18:15:07.143874 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-46c6a21b-4e96-4e21-96d5-44579bf83876 req-626b337c-8c4c-4c81-8121-af468cec0b77 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040886 Sep 26 18:15:07.144793 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 518/1052] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:15:07.279216 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-58a06a02-5c6e-46c3-895e-0b22bde5e777 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:07.290111 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-58a06a02-5c6e-46c3-895e-0b22bde5e777 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1757 microversion: 2.1 time: 0.187652 Sep 26 18:15:07.291308 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 535/1053] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:07 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:08.462346 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ce63a65c-93fd-4d93-ab9a-169c069b3bf7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:08.464870 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ce63a65c-93fd-4d93-ab9a-169c069b3bf7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:08.471289 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce63a65c-93fd-4d93-ab9a-169c069b3bf7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:08.471807 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce63a65c-93fd-4d93-ab9a-169c069b3bf7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:08.472300 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce63a65c-93fd-4d93-ab9a-169c069b3bf7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:08.472996 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce63a65c-93fd-4d93-ab9a-169c069b3bf7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:08.473452 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce63a65c-93fd-4d93-ab9a-169c069b3bf7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:08.473875 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ce63a65c-93fd-4d93-ab9a-169c069b3bf7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:08.504856 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ce63a65c-93fd-4d93-ab9a-169c069b3bf7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047780 Sep 26 18:15:08.505422 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 519/1054] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:15:08 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:15:08.644536 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-21b4afd7-229e-40ac-aaeb-b745b566cd41 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:08.645096 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-21b4afd7-229e-40ac-aaeb-b745b566cd41 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:08.651850 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-21b4afd7-229e-40ac-aaeb-b745b566cd41 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:08.652338 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-21b4afd7-229e-40ac-aaeb-b745b566cd41 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:08.652774 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-21b4afd7-229e-40ac-aaeb-b745b566cd41 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:08.653461 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-21b4afd7-229e-40ac-aaeb-b745b566cd41 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:08.653917 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-21b4afd7-229e-40ac-aaeb-b745b566cd41 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:08.654340 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-21b4afd7-229e-40ac-aaeb-b745b566cd41 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:08.684430 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-21b4afd7-229e-40ac-aaeb-b745b566cd41 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments/b79556d4-d076-4e29-b1cd-7726412e4da4" status: 200 len: 194 microversion: 2.1 time: 0.043863 Sep 26 18:15:08.685015 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 536/1055] 10.222.0.67 () {58 vars in 1413 bytes} [Mon Sep 26 18:15:08 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments/b79556d4-d076-4e29-b1cd-7726412e4da4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:15:08.695489 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2d49c29a-c73e-42bb-bf91-bd7a61595957 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:08.696016 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2d49c29a-c73e-42bb-bf91-bd7a61595957 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:08.701936 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2d49c29a-c73e-42bb-bf91-bd7a61595957 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:08.702420 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2d49c29a-c73e-42bb-bf91-bd7a61595957 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:08.702853 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2d49c29a-c73e-42bb-bf91-bd7a61595957 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:08.703542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2d49c29a-c73e-42bb-bf91-bd7a61595957 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:08.704034 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2d49c29a-c73e-42bb-bf91-bd7a61595957 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:08.704459 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-2d49c29a-c73e-42bb-bf91-bd7a61595957 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:08.783338 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-2d49c29a-c73e-42bb-bf91-bd7a61595957 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lazy-loading 'services' on Instance uuid a679ce86-f6fe-43f2-91ba-7910d805abfd {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:15:09.031448 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2d49c29a-c73e-42bb-bf91-bd7a61595957 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments/b79556d4-d076-4e29-b1cd-7726412e4da4" status: 202 len: 0 microversion: 2.1 time: 0.339684 Sep 26 18:15:09.032363 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 520/1056] 10.222.0.67 () {58 vars in 1416 bytes} [Mon Sep 26 18:15:08 2022] DELETE /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments/b79556d4-d076-4e29-b1cd-7726412e4da4 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:15:11.217611 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a1e39dd7-82b8-4a23-b363-d4bc225451bf tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:11.218152 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a1e39dd7-82b8-4a23-b363-d4bc225451bf tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:11.225051 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1e39dd7-82b8-4a23-b363-d4bc225451bf tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:11.225535 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1e39dd7-82b8-4a23-b363-d4bc225451bf tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:11.225964 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1e39dd7-82b8-4a23-b363-d4bc225451bf tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:11.226951 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1e39dd7-82b8-4a23-b363-d4bc225451bf tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:11.227415 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1e39dd7-82b8-4a23-b363-d4bc225451bf tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:11.227869 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1e39dd7-82b8-4a23-b363-d4bc225451bf tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:11.260390 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a1e39dd7-82b8-4a23-b363-d4bc225451bf tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments/ed1841d1-41aa-4db8-b622-160312ee0bf2" status: 200 len: 194 microversion: 2.1 time: 0.046818 Sep 26 18:15:11.260967 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 537/1057] 10.222.0.67 () {58 vars in 1413 bytes} [Mon Sep 26 18:15:11 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments/ed1841d1-41aa-4db8-b622-160312ee0bf2 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:15:11.276734 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-8cb7eacc-65ed-4a43-854f-8f2f59b06e45 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:11.277307 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-8cb7eacc-65ed-4a43-854f-8f2f59b06e45 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:11.283848 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8cb7eacc-65ed-4a43-854f-8f2f59b06e45 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:11.284327 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8cb7eacc-65ed-4a43-854f-8f2f59b06e45 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:11.284753 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8cb7eacc-65ed-4a43-854f-8f2f59b06e45 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:11.285432 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8cb7eacc-65ed-4a43-854f-8f2f59b06e45 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:11.285879 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8cb7eacc-65ed-4a43-854f-8f2f59b06e45 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:11.286304 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-8cb7eacc-65ed-4a43-854f-8f2f59b06e45 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:11.366356 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-8cb7eacc-65ed-4a43-854f-8f2f59b06e45 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lazy-loading 'services' on Instance uuid a679ce86-f6fe-43f2-91ba-7910d805abfd {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:15:11.544605 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-8cb7eacc-65ed-4a43-854f-8f2f59b06e45 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments/ed1841d1-41aa-4db8-b622-160312ee0bf2" status: 202 len: 0 microversion: 2.1 time: 0.276676 Sep 26 18:15:11.545194 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 521/1058] 10.222.0.67 () {58 vars in 1416 bytes} [Mon Sep 26 18:15:11 2022] DELETE /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments/ed1841d1-41aa-4db8-b622-160312ee0bf2 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:15:12.721798 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-076a4fed-8dfa-4b97-963e-f5df9804a05d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:12.724054 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-076a4fed-8dfa-4b97-963e-f5df9804a05d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:12.731340 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-076a4fed-8dfa-4b97-963e-f5df9804a05d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:12.731864 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-076a4fed-8dfa-4b97-963e-f5df9804a05d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:12.732302 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-076a4fed-8dfa-4b97-963e-f5df9804a05d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:12.732994 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-076a4fed-8dfa-4b97-963e-f5df9804a05d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:12.733448 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-076a4fed-8dfa-4b97-963e-f5df9804a05d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:12.733913 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-076a4fed-8dfa-4b97-963e-f5df9804a05d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:12.762998 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-076a4fed-8dfa-4b97-963e-f5df9804a05d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045640 Sep 26 18:15:12.763543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 538/1059] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:15:12 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 18:15:12.879442 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9d0f92fa-66ef-475e-93ea-f129e0e63802 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:12.882356 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9d0f92fa-66ef-475e-93ea-f129e0e63802 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:12.889270 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d0f92fa-66ef-475e-93ea-f129e0e63802 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:12.889757 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d0f92fa-66ef-475e-93ea-f129e0e63802 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:12.890196 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d0f92fa-66ef-475e-93ea-f129e0e63802 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:12.890889 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d0f92fa-66ef-475e-93ea-f129e0e63802 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:12.891349 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d0f92fa-66ef-475e-93ea-f129e0e63802 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:12.891817 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9d0f92fa-66ef-475e-93ea-f129e0e63802 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:12.921412 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9d0f92fa-66ef-475e-93ea-f129e0e63802 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046758 Sep 26 18:15:12.921968 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 522/1060] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:15:12 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 18:15:12.986378 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ff57d72f-3a10-4a53-ab37-e7d3e4d82331 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:12.992919 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ff57d72f-3a10-4a53-ab37-e7d3e4d82331 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:12.993678 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ff57d72f-3a10-4a53-ab37-e7d3e4d82331 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:12.994056 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ff57d72f-3a10-4a53-ab37-e7d3e4d82331 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:12.994491 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ff57d72f-3a10-4a53-ab37-e7d3e4d82331 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:12.995214 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ff57d72f-3a10-4a53-ab37-e7d3e4d82331 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:12.995700 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ff57d72f-3a10-4a53-ab37-e7d3e4d82331 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:12.996129 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ff57d72f-3a10-4a53-ab37-e7d3e4d82331 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:13.020965 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ff57d72f-3a10-4a53-ab37-e7d3e4d82331 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Going to try to terminate instance {{(pid=121029) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:15:13.305991 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ff57d72f-3a10-4a53-ab37-e7d3e4d82331 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 204 len: 0 microversion: 2.1 time: 0.322380 Sep 26 18:15:13.306587 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 539/1061] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:15:12 2022] DELETE /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:15:13.314731 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-fe7c4add-2850-43bf-9909-7f006c5cf91d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:13.315541 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-fe7c4add-2850-43bf-9909-7f006c5cf91d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:13.322398 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fe7c4add-2850-43bf-9909-7f006c5cf91d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:13.322879 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fe7c4add-2850-43bf-9909-7f006c5cf91d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:13.323312 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fe7c4add-2850-43bf-9909-7f006c5cf91d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:13.324029 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fe7c4add-2850-43bf-9909-7f006c5cf91d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:13.324479 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fe7c4add-2850-43bf-9909-7f006c5cf91d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:13.324897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fe7c4add-2850-43bf-9909-7f006c5cf91d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:13.458511 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-fe7c4add-2850-43bf-9909-7f006c5cf91d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:13.466502 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-fe7c4add-2850-43bf-9909-7f006c5cf91d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1674 microversion: 2.1 time: 0.155599 Sep 26 18:15:13.467071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 523/1062] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:13 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:15:14.490310 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e54f32b3-f077-4b91-8862-cd334a594b9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:14.491010 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e54f32b3-f077-4b91-8862-cd334a594b9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:14.497990 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e54f32b3-f077-4b91-8862-cd334a594b9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:14.498478 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e54f32b3-f077-4b91-8862-cd334a594b9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:14.498912 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e54f32b3-f077-4b91-8862-cd334a594b9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:14.499604 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e54f32b3-f077-4b91-8862-cd334a594b9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:14.500115 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e54f32b3-f077-4b91-8862-cd334a594b9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:14.500539 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e54f32b3-f077-4b91-8862-cd334a594b9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:14.629582 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e54f32b3-f077-4b91-8862-cd334a594b9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:14.637789 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e54f32b3-f077-4b91-8862-cd334a594b9c tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1674 microversion: 2.1 time: 0.151830 Sep 26 18:15:14.638360 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 540/1063] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:14 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:15.661988 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ff661874-8f19-4b26-8728-5de79e02bc1a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:15.662531 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ff661874-8f19-4b26-8728-5de79e02bc1a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:15.670213 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ff661874-8f19-4b26-8728-5de79e02bc1a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:15.670705 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ff661874-8f19-4b26-8728-5de79e02bc1a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:15.671136 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ff661874-8f19-4b26-8728-5de79e02bc1a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:15.671869 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ff661874-8f19-4b26-8728-5de79e02bc1a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:15.672325 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ff661874-8f19-4b26-8728-5de79e02bc1a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:15.672743 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ff661874-8f19-4b26-8728-5de79e02bc1a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:15.896132 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-ff661874-8f19-4b26-8728-5de79e02bc1a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:15.904273 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ff661874-8f19-4b26-8728-5de79e02bc1a tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1674 microversion: 2.1 time: 0.246232 Sep 26 18:15:15.904866 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 524/1064] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:15 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1674 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:16.333357 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-b0145bbf-91a1-446a-b652-839010e0f341 req-a4af998c-3f2e-4383-9af7-b70951ad88e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a679ce86-f6fe-43f2-91ba-7910d805abfd", "name": "network-vif-deleted", "tag": "35358136-74af-49bb-a78d-b31cb0a84ec0"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:15:16.347138 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-b0145bbf-91a1-446a-b652-839010e0f341 req-a4af998c-3f2e-4383-9af7-b70951ad88e3 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:16.348488 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-b0145bbf-91a1-446a-b652-839010e0f341 req-a4af998c-3f2e-4383-9af7-b70951ad88e3 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:16.348488 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-b0145bbf-91a1-446a-b652-839010e0f341 req-a4af998c-3f2e-4383-9af7-b70951ad88e3 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:16.360164 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-b0145bbf-91a1-446a-b652-839010e0f341 req-a4af998c-3f2e-4383-9af7-b70951ad88e3 service nova] Creating event network-vif-deleted:35358136-74af-49bb-a78d-b31cb0a84ec0 for instance a679ce86-f6fe-43f2-91ba-7910d805abfd on hv-cinder-85931 Sep 26 18:15:16.365395 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-b0145bbf-91a1-446a-b652-839010e0f341 req-a4af998c-3f2e-4383-9af7-b70951ad88e3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036676 Sep 26 18:15:16.366159 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 541/1065] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:15:16.929073 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-809196cc-5e51-4c22-b44b-115cbb3ce706 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:16.929706 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-809196cc-5e51-4c22-b44b-115cbb3ce706 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:16.936631 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-809196cc-5e51-4c22-b44b-115cbb3ce706 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:16.937130 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-809196cc-5e51-4c22-b44b-115cbb3ce706 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:16.937549 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-809196cc-5e51-4c22-b44b-115cbb3ce706 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:16.938236 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-809196cc-5e51-4c22-b44b-115cbb3ce706 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:16.938684 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-809196cc-5e51-4c22-b44b-115cbb3ce706 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:16.939106 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-809196cc-5e51-4c22-b44b-115cbb3ce706 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:16.971373 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-809196cc-5e51-4c22-b44b-115cbb3ce706 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:16.971883 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-809196cc-5e51-4c22-b44b-115cbb3ce706 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:16.972317 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-809196cc-5e51-4c22-b44b-115cbb3ce706 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:16.972752 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-809196cc-5e51-4c22-b44b-115cbb3ce706 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lazy-loading 'fault' on Instance uuid a679ce86-f6fe-43f2-91ba-7910d805abfd {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:15:17.018514 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-809196cc-5e51-4c22-b44b-115cbb3ce706 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1cdc37455c489fb45e1ce3e2421cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7750acf9ab4843d1a3848472e99881a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:17.027542 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-809196cc-5e51-4c22-b44b-115cbb3ce706 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 200 len: 1327 microversion: 2.1 time: 0.102813 Sep 26 18:15:17.039933 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 525/1066] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:16 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:18.052104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-149ec961-be4f-4418-af33-f2dc2b0b7f7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:18.052812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-149ec961-be4f-4418-af33-f2dc2b0b7f7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:18.061496 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-149ec961-be4f-4418-af33-f2dc2b0b7f7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:18.062052 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-149ec961-be4f-4418-af33-f2dc2b0b7f7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:18.062493 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-149ec961-be4f-4418-af33-f2dc2b0b7f7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:18.063228 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-149ec961-be4f-4418-af33-f2dc2b0b7f7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:18.063684 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-149ec961-be4f-4418-af33-f2dc2b0b7f7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:18.064126 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-149ec961-be4f-4418-af33-f2dc2b0b7f7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:18.077902 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-149ec961-be4f-4418-af33-f2dc2b0b7f7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] HTTP exception thrown: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-149ec961-be4f-4418-af33-f2dc2b0b7f7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Request method failure captured: Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd HTTP/1.1 Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMersCjB96hhUUCuOXgeVD_Ya0yb8-4iI8cWD7nU9LkFp6Q4_oJwMnm_bbqwDG5pIG6Mk3C63LIrRPVEhn_4twwV90yqaTNLH3XmCOCHL6xyaSlMn_KYVhT5xugq0TKEunpwCbyOUNlbybCHAN89CYP8tngT2-nIy34rEtalpBmmuXh0 Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: 7750acf9ab4843d1a3848472e99881a1 Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:15:18.079543 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:15:18.081066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:15:18.081066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:15:18.081066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: 7750acf9ab4843d1a3848472e99881a1 Sep 26 18:15:18.081066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:15:18.081066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-AttachVolumeTestJSON-954633196-project Sep 26 18:15:18.081066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:15:18.081066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:15:18.081066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 4b1cdc37455c489fb45e1ce3e2421cc0 Sep 26 18:15:18.081066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-AttachVolumeTestJSON-954633196-project Sep 26 18:15:18.081066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:15:18.081066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. Sep 26 18:15:18.081066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': 'a679ce86-f6fe-43f2-91ba-7910d805abfd'} Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:15:18.082272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. Sep 26 18:15:18.083637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:18.084894 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-149ec961-be4f-4418-af33-f2dc2b0b7f7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Returning 404 to user: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:15:18.084894 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-149ec961-be4f-4418-af33-f2dc2b0b7f7f tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 404 len: 111 microversion: 2.1 time: 0.033146 Sep 26 18:15:18.084894 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 542/1067] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:18 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:15:18.090757 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a180b5b1-2045-44dd-aaca-dbefcaa0d86d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '.version_select at 0x7f3a74b4c040>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:18.153214 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a180b5b1-2045-44dd-aaca-dbefcaa0d86d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1594929119" status: 202 len: 0 microversion: 2.1 time: 0.067025 Sep 26 18:15:18.153801 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 526/1068] 10.222.0.67 () {58 vars in 1221 bytes} [Mon Sep 26 18:15:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1594929119 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:15:21.282044 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9bd99974-3f41-4ad0-acba-c276f2bf971a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:15:21.284163 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9bd99974-3f41-4ad0-acba-c276f2bf971a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:21.290551 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9bd99974-3f41-4ad0-acba-c276f2bf971a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:21.291784 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9bd99974-3f41-4ad0-acba-c276f2bf971a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:21.292381 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9bd99974-3f41-4ad0-acba-c276f2bf971a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:21.293110 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9bd99974-3f41-4ad0-acba-c276f2bf971a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:21.293622 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9bd99974-3f41-4ad0-acba-c276f2bf971a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:21.294097 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9bd99974-3f41-4ad0-acba-c276f2bf971a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:21.446027 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9bd99974-3f41-4ad0-acba-c276f2bf971a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "POST /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/action" status: 202 len: 0 microversion: 2.1 time: 0.167765 Sep 26 18:15:21.450383 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 543/1069] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Sep 26 18:15:21 2022] POST /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:15:21.456599 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d367d088-9021-49b5-9d6e-1cc9e2162f31 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:21.457172 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d367d088-9021-49b5-9d6e-1cc9e2162f31 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:21.464345 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d367d088-9021-49b5-9d6e-1cc9e2162f31 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:21.464871 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d367d088-9021-49b5-9d6e-1cc9e2162f31 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:21.465304 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d367d088-9021-49b5-9d6e-1cc9e2162f31 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:21.465996 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d367d088-9021-49b5-9d6e-1cc9e2162f31 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:21.466218 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8911115a-05f5-4d8d-aea7-8a3a4cdbcc6d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:21.466484 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d367d088-9021-49b5-9d6e-1cc9e2162f31 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:21.466905 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-8911115a-05f5-4d8d-aea7-8a3a4cdbcc6d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:21.467050 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d367d088-9021-49b5-9d6e-1cc9e2162f31 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:21.473230 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8911115a-05f5-4d8d-aea7-8a3a4cdbcc6d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:21.473716 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8911115a-05f5-4d8d-aea7-8a3a4cdbcc6d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:21.474248 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8911115a-05f5-4d8d-aea7-8a3a4cdbcc6d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:21.474940 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8911115a-05f5-4d8d-aea7-8a3a4cdbcc6d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:21.475399 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8911115a-05f5-4d8d-aea7-8a3a4cdbcc6d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:21.475881 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-8911115a-05f5-4d8d-aea7-8a3a4cdbcc6d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:21.490204 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-8911115a-05f5-4d8d-aea7-8a3a4cdbcc6d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] HTTP exception thrown: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8911115a-05f5-4d8d-aea7-8a3a4cdbcc6d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Request method failure captured: Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: DELETE /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd HTTP/1.1 Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMersCjB96hhUUCuOXgeVD_Ya0yb8-4iI8cWD7nU9LkFp6Q4_oJwMnm_bbqwDG5pIG6Mk3C63LIrRPVEhn_4twwV90yqaTNLH3XmCOCHL6xyaSlMn_KYVhT5xugq0TKEunpwCbyOUNlbybCHAN89CYP8tngT2-nIy34rEtalpBmmuXh0 Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: 7750acf9ab4843d1a3848472e99881a1 Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:15:21.492245 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:15:21.494797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:15:21.494797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:15:21.494797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: 7750acf9ab4843d1a3848472e99881a1 Sep 26 18:15:21.494797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:15:21.494797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-AttachVolumeTestJSON-954633196-project Sep 26 18:15:21.494797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:15:21.494797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:15:21.494797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 4b1cdc37455c489fb45e1ce3e2421cc0 Sep 26 18:15:21.494797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-AttachVolumeTestJSON-954633196-project Sep 26 18:15:21.494797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:15:21.494797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. Sep 26 18:15:21.494797 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': 'a679ce86-f6fe-43f2-91ba-7910d805abfd'} Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:15:21.495960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. Sep 26 18:15:21.497434 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:21.499611 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-8911115a-05f5-4d8d-aea7-8a3a4cdbcc6d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Returning 404 to user: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:15:21.500487 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-8911115a-05f5-4d8d-aea7-8a3a4cdbcc6d tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 404 len: 111 microversion: 2.1 time: 0.038894 Sep 26 18:15:21.501052 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 544/1070] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:15:21 2022] DELETE /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:15:21.508650 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-18bb829d-4572-4798-a5d5-61f26db604f7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:21.511147 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-18bb829d-4572-4798-a5d5-61f26db604f7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: a679ce86-f6fe-43f2-91ba-7910d805abfd] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:21.516252 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-18bb829d-4572-4798-a5d5-61f26db604f7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:21.516732 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-18bb829d-4572-4798-a5d5-61f26db604f7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:21.517168 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-18bb829d-4572-4798-a5d5-61f26db604f7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:21.517862 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-18bb829d-4572-4798-a5d5-61f26db604f7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:21.518315 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-18bb829d-4572-4798-a5d5-61f26db604f7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:21.518756 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-18bb829d-4572-4798-a5d5-61f26db604f7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:21.538851 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-18bb829d-4572-4798-a5d5-61f26db604f7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] HTTP exception thrown: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-18bb829d-4572-4798-a5d5-61f26db604f7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Request method failure captured: Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd HTTP/1.1 Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMersCjB96hhUUCuOXgeVD_Ya0yb8-4iI8cWD7nU9LkFp6Q4_oJwMnm_bbqwDG5pIG6Mk3C63LIrRPVEhn_4twwV90yqaTNLH3XmCOCHL6xyaSlMn_KYVhT5xugq0TKEunpwCbyOUNlbybCHAN89CYP8tngT2-nIy34rEtalpBmmuXh0 Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: 7750acf9ab4843d1a3848472e99881a1 Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:15:21.541566 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:15:21.543022 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:15:21.543022 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:15:21.543022 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: 7750acf9ab4843d1a3848472e99881a1 Sep 26 18:15:21.543022 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:15:21.543022 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-AttachVolumeTestJSON-954633196-project Sep 26 18:15:21.543022 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:15:21.543022 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:15:21.543022 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 4b1cdc37455c489fb45e1ce3e2421cc0 Sep 26 18:15:21.543022 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-AttachVolumeTestJSON-954633196-project Sep 26 18:15:21.543022 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:15:21.543022 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. Sep 26 18:15:21.543022 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': 'a679ce86-f6fe-43f2-91ba-7910d805abfd'} Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:15:21.543823 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. Sep 26 18:15:21.545106 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:21.546250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-18bb829d-4572-4798-a5d5-61f26db604f7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Returning 404 to user: Instance a679ce86-f6fe-43f2-91ba-7910d805abfd could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:15:21.546250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-18bb829d-4572-4798-a5d5-61f26db604f7 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd" status: 404 len: 111 microversion: 2.1 time: 0.037920 Sep 26 18:15:21.547438 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 545/1071] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:21 2022] GET /compute/v2.1/servers/a679ce86-f6fe-43f2-91ba-7910d805abfd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:15:21.667519 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d367d088-9021-49b5-9d6e-1cc9e2162f31 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:21.675903 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d367d088-9021-49b5-9d6e-1cc9e2162f31 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1749 microversion: 2.1 time: 0.224175 Sep 26 18:15:21.676477 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 527/1072] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:21 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1749 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:22.699686 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-560d20a9-213e-4c95-a40d-c251bf2a2185 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:22.700287 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-560d20a9-213e-4c95-a40d-c251bf2a2185 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:22.706517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-560d20a9-213e-4c95-a40d-c251bf2a2185 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:22.706992 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-560d20a9-213e-4c95-a40d-c251bf2a2185 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:22.707415 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-560d20a9-213e-4c95-a40d-c251bf2a2185 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:22.708130 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-560d20a9-213e-4c95-a40d-c251bf2a2185 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:22.708577 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-560d20a9-213e-4c95-a40d-c251bf2a2185 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:22.708994 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-560d20a9-213e-4c95-a40d-c251bf2a2185 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:22.833488 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-bbebd1d9-6421-4906-89f4-f5808306feff tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:22.833984 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-bbebd1d9-6421-4906-89f4-f5808306feff tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:22.841145 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bbebd1d9-6421-4906-89f4-f5808306feff tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:22.841638 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bbebd1d9-6421-4906-89f4-f5808306feff tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:22.842079 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bbebd1d9-6421-4906-89f4-f5808306feff tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:22.842864 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bbebd1d9-6421-4906-89f4-f5808306feff tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:22.843332 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bbebd1d9-6421-4906-89f4-f5808306feff tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:22.843823 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-bbebd1d9-6421-4906-89f4-f5808306feff tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:22.859155 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-bbebd1d9-6421-4906-89f4-f5808306feff tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] HTTP exception thrown: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. Sep 26 18:15:22.859325 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-560d20a9-213e-4c95-a40d-c251bf2a2185 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-bbebd1d9-6421-4906-89f4-f5808306feff tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Request method failure captured: Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: DELETE /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db HTTP/1.1 Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMersCjB96hhUUCuOXgeVD_Ya0yb8-4iI8cWD7nU9LkFp6Q4_oJwMnm_bbqwDG5pIG6Mk3C63LIrRPVEhn_4twwV90yqaTNLH3XmCOCHL6xyaSlMn_KYVhT5xugq0TKEunpwCbyOUNlbybCHAN89CYP8tngT2-nIy34rEtalpBmmuXh0 Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 7750acf9ab4843d1a3848472e99881a1 Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:15:22.861437 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:15:22.863108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:15:22.863108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:15:22.863108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 7750acf9ab4843d1a3848472e99881a1 Sep 26 18:15:22.863108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:15:22.863108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-AttachVolumeTestJSON-954633196-project Sep 26 18:15:22.863108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:15:22.863108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:15:22.863108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 4b1cdc37455c489fb45e1ce3e2421cc0 Sep 26 18:15:22.863108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-AttachVolumeTestJSON-954633196-project Sep 26 18:15:22.863108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:15:22.863108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. Sep 26 18:15:22.863108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '7369614f-dc83-49a8-b16c-2c2189b1e9db'} Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:15:22.864055 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. Sep 26 18:15:22.865532 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:22.866887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-bbebd1d9-6421-4906-89f4-f5808306feff tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Returning 404 to user: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:15:22.866887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-bbebd1d9-6421-4906-89f4-f5808306feff tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 404 len: 111 microversion: 2.1 time: 0.034615 Sep 26 18:15:22.866887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 528/1073] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:15:22 2022] DELETE /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:15:22.867780 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-560d20a9-213e-4c95-a40d-c251bf2a2185 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1749 microversion: 2.1 time: 0.172111 Sep 26 18:15:22.868345 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 546/1074] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:22 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:22.879847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-de8700ad-2961-4264-8e5b-4727ebc42ee6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:22.879847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-de8700ad-2961-4264-8e5b-4727ebc42ee6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] [instance: 7369614f-dc83-49a8-b16c-2c2189b1e9db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:22.880518 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de8700ad-2961-4264-8e5b-4727ebc42ee6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:22.881122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de8700ad-2961-4264-8e5b-4727ebc42ee6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:22.881563 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de8700ad-2961-4264-8e5b-4727ebc42ee6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:22.882255 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de8700ad-2961-4264-8e5b-4727ebc42ee6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:22.882708 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de8700ad-2961-4264-8e5b-4727ebc42ee6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:22.883135 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-de8700ad-2961-4264-8e5b-4727ebc42ee6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:22.899276 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-de8700ad-2961-4264-8e5b-4727ebc42ee6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] HTTP exception thrown: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-de8700ad-2961-4264-8e5b-4727ebc42ee6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Request method failure captured: Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db HTTP/1.1 Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMersCjB96hhUUCuOXgeVD_Ya0yb8-4iI8cWD7nU9LkFp6Q4_oJwMnm_bbqwDG5pIG6Mk3C63LIrRPVEhn_4twwV90yqaTNLH3XmCOCHL6xyaSlMn_KYVhT5xugq0TKEunpwCbyOUNlbybCHAN89CYP8tngT2-nIy34rEtalpBmmuXh0 Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 7750acf9ab4843d1a3848472e99881a1 Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:15:22.901342 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:15:22.902985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7750acf9ab4843d1a3848472e99881a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:15:22.902985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:15:22.902985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 7750acf9ab4843d1a3848472e99881a1 Sep 26 18:15:22.902985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-AttachVolumeTestJSON-954633196 Sep 26 18:15:22.902985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-AttachVolumeTestJSON-954633196-project Sep 26 18:15:22.902985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:15:22.902985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:15:22.902985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 4b1cdc37455c489fb45e1ce3e2421cc0 Sep 26 18:15:22.902985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-AttachVolumeTestJSON-954633196-project Sep 26 18:15:22.902985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:15:22.902985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. Sep 26 18:15:22.902985 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '7369614f-dc83-49a8-b16c-2c2189b1e9db'} Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:15:22.904070 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. Sep 26 18:15:22.905334 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:22.906566 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-de8700ad-2961-4264-8e5b-4727ebc42ee6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] Returning 404 to user: Instance 7369614f-dc83-49a8-b16c-2c2189b1e9db could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:15:22.906566 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-de8700ad-2961-4264-8e5b-4727ebc42ee6 tempest-AttachVolumeTestJSON-954633196 tempest-AttachVolumeTestJSON-954633196-project] 10.222.0.67 "GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db" status: 404 len: 111 microversion: 2.1 time: 0.032828 Sep 26 18:15:22.906566 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 529/1075] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:22 2022] GET /compute/v2.1/servers/7369614f-dc83-49a8-b16c-2c2189b1e9db => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:15:23.898353 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-63e64c31-59f3-445a-a000-0acf049991b9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:23.898961 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-63e64c31-59f3-445a-a000-0acf049991b9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:23.906261 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-63e64c31-59f3-445a-a000-0acf049991b9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:23.906670 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-63e64c31-59f3-445a-a000-0acf049991b9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:23.907099 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-63e64c31-59f3-445a-a000-0acf049991b9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:23.907826 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-63e64c31-59f3-445a-a000-0acf049991b9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:23.908281 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-63e64c31-59f3-445a-a000-0acf049991b9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:23.908699 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-63e64c31-59f3-445a-a000-0acf049991b9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:24.050618 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-63e64c31-59f3-445a-a000-0acf049991b9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:24.059344 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-63e64c31-59f3-445a-a000-0acf049991b9 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1754 microversion: 2.1 time: 0.165096 Sep 26 18:15:24.059952 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 547/1076] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:23 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:25.091676 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9cd24f8f-939f-4bce-bf52-efce05948958 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:25.093302 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9cd24f8f-939f-4bce-bf52-efce05948958 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:25.103066 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9cd24f8f-939f-4bce-bf52-efce05948958 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:25.104981 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9cd24f8f-939f-4bce-bf52-efce05948958 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:25.105816 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9cd24f8f-939f-4bce-bf52-efce05948958 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:25.106774 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9cd24f8f-939f-4bce-bf52-efce05948958 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:25.107452 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9cd24f8f-939f-4bce-bf52-efce05948958 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:25.108119 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9cd24f8f-939f-4bce-bf52-efce05948958 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:25.332846 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9cd24f8f-939f-4bce-bf52-efce05948958 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:25.345212 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9cd24f8f-939f-4bce-bf52-efce05948958 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1754 microversion: 2.1 time: 0.265643 Sep 26 18:15:25.345952 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 530/1077] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:25 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1754 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:26.373416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-92fe9672-633d-4a55-82dc-804b3d6bf79f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:26.378298 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-92fe9672-633d-4a55-82dc-804b3d6bf79f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:26.386708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-92fe9672-633d-4a55-82dc-804b3d6bf79f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:26.388105 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-92fe9672-633d-4a55-82dc-804b3d6bf79f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:26.388840 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-92fe9672-633d-4a55-82dc-804b3d6bf79f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:26.389852 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-92fe9672-633d-4a55-82dc-804b3d6bf79f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:26.390577 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-92fe9672-633d-4a55-82dc-804b3d6bf79f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:26.391256 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-92fe9672-633d-4a55-82dc-804b3d6bf79f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:26.568441 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-92fe9672-633d-4a55-82dc-804b3d6bf79f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:26.579159 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-92fe9672-633d-4a55-82dc-804b3d6bf79f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1754 microversion: 2.1 time: 0.210162 Sep 26 18:15:26.594521 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 548/1078] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:26 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1754 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:27.604574 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-9a3724f3-9c0d-49a0-946b-0da99a0412c0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:27.605824 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-9a3724f3-9c0d-49a0-946b-0da99a0412c0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:27.609558 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:15:27.613149 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a3724f3-9c0d-49a0-946b-0da99a0412c0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:27.613830 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a3724f3-9c0d-49a0-946b-0da99a0412c0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:27.614265 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a3724f3-9c0d-49a0-946b-0da99a0412c0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:27.614965 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a3724f3-9c0d-49a0-946b-0da99a0412c0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:27.615431 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a3724f3-9c0d-49a0-946b-0da99a0412c0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:27.615886 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-9a3724f3-9c0d-49a0-946b-0da99a0412c0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:27.618821 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:15:27.764487 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-9a3724f3-9c0d-49a0-946b-0da99a0412c0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:27.773206 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-9a3724f3-9c0d-49a0-946b-0da99a0412c0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1754 microversion: 2.1 time: 0.172766 Sep 26 18:15:27.773772 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 531/1079] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:27 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:15:28.666076 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a4653cda-e539-4168-bc49-04b37f5af1f0 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Action: 'create', calling method: .version_select at 0x7f3a74c84700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1500401948"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:15:28.799249 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c24395b6-ea8b-453c-9acf-19d6625a0618 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:28.799982 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c24395b6-ea8b-453c-9acf-19d6625a0618 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:28.807471 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c24395b6-ea8b-453c-9acf-19d6625a0618 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:28.807994 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c24395b6-ea8b-453c-9acf-19d6625a0618 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:28.808424 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c24395b6-ea8b-453c-9acf-19d6625a0618 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:28.809115 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c24395b6-ea8b-453c-9acf-19d6625a0618 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:28.809564 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c24395b6-ea8b-453c-9acf-19d6625a0618 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:28.809984 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c24395b6-ea8b-453c-9acf-19d6625a0618 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:28.965202 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c24395b6-ea8b-453c-9acf-19d6625a0618 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:28.973708 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c24395b6-ea8b-453c-9acf-19d6625a0618 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1754 microversion: 2.1 time: 0.179699 Sep 26 18:15:28.974265 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 532/1080] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:28 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:29.312665 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a4653cda-e539-4168-bc49-04b37f5af1f0 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.760010 Sep 26 18:15:29.313222 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 549/1081] 10.222.0.67 () {60 vars in 1155 bytes} [Mon Sep 26 18:15:28 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 761 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 26 18:15:29.326281 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-54e05747-6e69-46b8-a5c8-6c497aeaff8e tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a7828e1f0>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:29.377302 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-54e05747-6e69-46b8-a5c8-6c497aeaff8e tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f" status: 200 len: 345 microversion: 2.1 time: 0.053075 Sep 26 18:15:29.377302 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 533/1082] 10.222.0.67 () {58 vars in 1245 bytes} [Mon Sep 26 18:15:29 2022] GET /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:15:30.001431 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-6876aea0-7125-4d80-861b-074d6c6464e5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:30.002057 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-6876aea0-7125-4d80-861b-074d6c6464e5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:30.008945 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6876aea0-7125-4d80-861b-074d6c6464e5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:30.009432 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6876aea0-7125-4d80-861b-074d6c6464e5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:30.009861 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6876aea0-7125-4d80-861b-074d6c6464e5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:30.010546 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6876aea0-7125-4d80-861b-074d6c6464e5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:30.011251 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6876aea0-7125-4d80-861b-074d6c6464e5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:30.011692 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-6876aea0-7125-4d80-861b-074d6c6464e5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:30.014328 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:15:30.160191 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-6876aea0-7125-4d80-861b-074d6c6464e5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:30.169194 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-6876aea0-7125-4d80-861b-074d6c6464e5 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1754 microversion: 2.1 time: 0.172235 Sep 26 18:15:30.169780 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 550/1083] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:29 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:30.389928 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b406f65f-7cb2-431c-b06e-d1371d9c04c8 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a74a8dca0>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:30.436249 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b406f65f-7cb2-431c-b06e-d1371d9c04c8 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f" status: 200 len: 346 microversion: 2.1 time: 0.050686 Sep 26 18:15:30.436820 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 534/1084] 10.222.0.67 () {58 vars in 1245 bytes} [Mon Sep 26 18:15:30 2022] GET /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:15:30.450521 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5d6442d1-dc1b-4f80-934c-e3f07a523bf8 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Action: 'create', calling method: .version_select at 0x7f3a749c6b80>, body: {"snapshot": {"volume_id": "1691beba-fdcb-4533-8544-8134e75b7c8f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1503669436"}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:15:30.848791 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5d6442d1-dc1b-4f80-934c-e3f07a523bf8 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.403040 Sep 26 18:15:30.849368 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 551/1085] 10.222.0.67 () {60 vars in 1162 bytes} [Mon Sep 26 18:15:30 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:15:30.860127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-811eae16-af4d-40eb-b6b4-9d3a42b8cb8a tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a74aa48b0>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:30.891016 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-811eae16-af4d-40eb-b6b4-9d3a42b8cb8a tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1" status: 200 len: 287 microversion: 2.1 time: 0.034542 Sep 26 18:15:30.891581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 535/1086] 10.222.0.67 () {58 vars in 1251 bytes} [Mon Sep 26 18:15:30 2022] GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:15:30.903005 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-883d523b-0dc4-401b-b716-a2992555a836 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a74ab7790>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:30.933962 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-883d523b-0dc4-401b-b716-a2992555a836 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035019 Sep 26 18:15:30.934555 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 552/1087] 10.222.0.67 () {58 vars in 1140 bytes} [Mon Sep 26 18:15:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:15:30.946104 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e47e882d-3ef9-4855-889e-c0b654865b15 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a74dcf310>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:30.977614 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e47e882d-3ef9-4855-889e-c0b654865b15 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1" status: 200 len: 287 microversion: 2.1 time: 0.035569 Sep 26 18:15:30.978178 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 536/1088] 10.222.0.67 () {58 vars in 1251 bytes} [Mon Sep 26 18:15:30 2022] GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:15:31.192546 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-cbfa804e-ccec-4294-93c7-498d4b7739f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:31.193962 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-cbfa804e-ccec-4294-93c7-498d4b7739f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:31.200927 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cbfa804e-ccec-4294-93c7-498d4b7739f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:31.201413 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cbfa804e-ccec-4294-93c7-498d4b7739f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:31.201850 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cbfa804e-ccec-4294-93c7-498d4b7739f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:31.202541 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cbfa804e-ccec-4294-93c7-498d4b7739f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:31.202999 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cbfa804e-ccec-4294-93c7-498d4b7739f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:31.203424 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cbfa804e-ccec-4294-93c7-498d4b7739f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:31.348623 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-cbfa804e-ccec-4294-93c7-498d4b7739f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:31.357907 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-cbfa804e-ccec-4294-93c7-498d4b7739f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1754 microversion: 2.1 time: 0.169802 Sep 26 18:15:31.358469 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 553/1089] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:31 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:31.990927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-7e9fa5d1-c22f-4227-ac39-58ecaefc6204 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a74a8daf0>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:32.022030 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-7e9fa5d1-c22f-4227-ac39-58ecaefc6204 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1" status: 200 len: 287 microversion: 2.1 time: 0.035525 Sep 26 18:15:32.022595 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 537/1090] 10.222.0.67 () {58 vars in 1251 bytes} [Mon Sep 26 18:15:31 2022] GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:15:32.381530 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e71b0c80-50a2-49e8-b281-8808392658d0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:32.382142 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e71b0c80-50a2-49e8-b281-8808392658d0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:32.384467 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:15:32.389860 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e71b0c80-50a2-49e8-b281-8808392658d0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:32.390342 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e71b0c80-50a2-49e8-b281-8808392658d0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:32.391235 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e71b0c80-50a2-49e8-b281-8808392658d0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:32.391494 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e71b0c80-50a2-49e8-b281-8808392658d0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:32.391999 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e71b0c80-50a2-49e8-b281-8808392658d0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:32.392423 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e71b0c80-50a2-49e8-b281-8808392658d0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:32.533672 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e71b0c80-50a2-49e8-b281-8808392658d0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:32.542180 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e71b0c80-50a2-49e8-b281-8808392658d0 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1754 microversion: 2.1 time: 0.164261 Sep 26 18:15:32.542739 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 554/1091] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:32 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:33.036170 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-29807e62-3e7c-401b-a2a5-8750eb80b9ae tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a74b53d30>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:33.068718 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-29807e62-3e7c-401b-a2a5-8750eb80b9ae tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1" status: 200 len: 287 microversion: 2.1 time: 0.036950 Sep 26 18:15:33.069276 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 538/1092] 10.222.0.67 () {58 vars in 1251 bytes} [Mon Sep 26 18:15:33 2022] GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:15:33.565268 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c00a2406-d903-40e0-b796-49042f340736 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:33.565909 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-c00a2406-d903-40e0-b796-49042f340736 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:33.572417 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c00a2406-d903-40e0-b796-49042f340736 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:33.572894 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c00a2406-d903-40e0-b796-49042f340736 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:33.573972 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c00a2406-d903-40e0-b796-49042f340736 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:33.574674 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c00a2406-d903-40e0-b796-49042f340736 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:33.575127 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c00a2406-d903-40e0-b796-49042f340736 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:33.575545 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-c00a2406-d903-40e0-b796-49042f340736 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:33.722317 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-c00a2406-d903-40e0-b796-49042f340736 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:33.728798 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c00a2406-d903-40e0-b796-49042f340736 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1754 microversion: 2.1 time: 0.167495 Sep 26 18:15:33.729440 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 555/1093] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:33 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:34.082895 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-587f508f-10f5-4850-ab90-cf72749c43b7 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a74b4cee0>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:34.114588 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-587f508f-10f5-4850-ab90-cf72749c43b7 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1" status: 200 len: 287 microversion: 2.1 time: 0.035973 Sep 26 18:15:34.115146 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 539/1094] 10.222.0.67 () {58 vars in 1251 bytes} [Mon Sep 26 18:15:34 2022] GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:15:34.752284 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-690f7e51-685c-4532-93da-dc9453becead tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:34.752872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-690f7e51-685c-4532-93da-dc9453becead tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:34.759281 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-690f7e51-685c-4532-93da-dc9453becead tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:34.759801 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-690f7e51-685c-4532-93da-dc9453becead tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:34.760233 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-690f7e51-685c-4532-93da-dc9453becead tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:34.761224 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-690f7e51-685c-4532-93da-dc9453becead tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:34.761776 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-690f7e51-685c-4532-93da-dc9453becead tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:34.762430 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-690f7e51-685c-4532-93da-dc9453becead tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:34.909558 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-690f7e51-685c-4532-93da-dc9453becead tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:34.918556 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-690f7e51-685c-4532-93da-dc9453becead tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1754 microversion: 2.1 time: 0.170109 Sep 26 18:15:34.919259 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 556/1095] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:34 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:35.128007 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-44cc94d8-1184-4771-85fb-32503b920bc7 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a74b03dc0>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:35.157876 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-44cc94d8-1184-4771-85fb-32503b920bc7 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1" status: 200 len: 288 microversion: 2.1 time: 0.034169 Sep 26 18:15:35.158425 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 540/1096] 10.222.0.67 () {58 vars in 1251 bytes} [Mon Sep 26 18:15:35 2022] GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:15:35.170306 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-dd5643b5-af2c-4f64-9712-08859c45fba9 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a74bdc8b0>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:35.328603 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-dd5643b5-af2c-4f64-9712-08859c45fba9 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "DELETE /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1" status: 202 len: 0 microversion: 2.1 time: 0.162757 Sep 26 18:15:35.329171 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 557/1097] 10.222.0.67 () {58 vars in 1254 bytes} [Mon Sep 26 18:15:35 2022] DELETE /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:15:35.337494 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-045ad876-3bda-412b-aaad-376acc6f7a13 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a74a8d430>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:35.368649 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-045ad876-3bda-412b-aaad-376acc6f7a13 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1" status: 200 len: 287 microversion: 2.1 time: 0.035030 Sep 26 18:15:35.369216 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 541/1098] 10.222.0.67 () {58 vars in 1251 bytes} [Mon Sep 26 18:15:35 2022] GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:15:35.951533 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-2bdd87f7-094d-4e85-bb86-97203ea0213a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:35.952231 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-2bdd87f7-094d-4e85-bb86-97203ea0213a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:15:35.958122 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2bdd87f7-094d-4e85-bb86-97203ea0213a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:35.958607 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2bdd87f7-094d-4e85-bb86-97203ea0213a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:35.959025 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2bdd87f7-094d-4e85-bb86-97203ea0213a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:35.959735 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2bdd87f7-094d-4e85-bb86-97203ea0213a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:15:35.960187 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2bdd87f7-094d-4e85-bb86-97203ea0213a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:15:35.960606 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2bdd87f7-094d-4e85-bb86-97203ea0213a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:15:36.106389 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-2bdd87f7-094d-4e85-bb86-97203ea0213a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:15:36.114638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-2bdd87f7-094d-4e85-bb86-97203ea0213a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1757 microversion: 2.1 time: 0.168074 Sep 26 18:15:36.115206 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 558/1099] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:15:35 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:15:36.382138 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-59cfc981-ff69-4e92-b345-b2acf76a7c20 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a74b03940>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:36.407470 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-59cfc981-ff69-4e92-b345-b2acf76a7c20 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] HTTP exception thrown: Snapshot 1d72d609-cfea-4736-b795-681726b1baf1 could not be found. Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-59cfc981-ff69-4e92-b345-b2acf76a7c20 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Request method failure captured: Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1 HTTP/1.1 Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMexAAVlhqGqs2kBO6CFKAihnGQjEfntBw4segWh_IY5sHu6smuHuI3QIQgtK7kvcZq8p6O96YiFuDMHbE4S1_ZPuBW2VODY_u7hWYrSHYMCB9YbxXzvBOahfCDM5ZHAVCEJb1H2AX3XCNDFTkhoWX-SrFmTx2MdCFKmVchLfCWOeFNo Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 909137c2da3f40b4bbb1072a22965ada Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1060760586 Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:15:36.409867 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:15:36.411682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/909137c2da3f40b4bbb1072a22965ada"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/909137c2da3f40b4bbb1072a22965ada"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_909137c2da3f40b4bbb1072a22965ada"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/909137c2da3f40b4bbb1072a22965ada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:15:36.411682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1060760586 Sep 26 18:15:36.411682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 909137c2da3f40b4bbb1072a22965ada Sep 26 18:15:36.411682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1060760586 Sep 26 18:15:36.411682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-VolumesSnapshotsTestJSON-1060760586-project Sep 26 18:15:36.411682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:15:36.411682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:15:36.411682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: ea5d62d563924fcd89427ad0a0166c1b Sep 26 18:15:36.411682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1060760586-project Sep 26 18:15:36.411682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: Sep 26 18:15:36.411682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Snapshot 1d72d609-cfea-4736-b795-681726b1baf1 could not be found. Sep 26 18:15:36.411682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '1d72d609-cfea-4736-b795-681726b1baf1'} Sep 26 18:15:36.411682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1d72d609-cfea-4736-b795-681726b1baf1 could not be found. (HTTP 404) (Request-ID: req-9f70e967-ff26-4d11-9114-b30309104548) Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:36.412784 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 18:15:36.414200 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1d72d609-cfea-4736-b795-681726b1baf1 could not be found. Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 26 18:15:36.415686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:15:36.417517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1d72d609-cfea-4736-b795-681726b1baf1 could not be found. Sep 26 18:15:36.417517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:36.417517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:36.417517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:36.417517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:36.417517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:36.417517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:36.417517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:15:36.417517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:15:36.417517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1d72d609-cfea-4736-b795-681726b1baf1 could not be found. Sep 26 18:15:36.417517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:36.417517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-59cfc981-ff69-4e92-b345-b2acf76a7c20 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Returning 404 to user: Snapshot 1d72d609-cfea-4736-b795-681726b1baf1 could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:15:36.417517 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-59cfc981-ff69-4e92-b345-b2acf76a7c20 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1" status: 404 len: 111 microversion: 2.1 time: 0.033473 Sep 26 18:15:36.418697 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 542/1100] 10.222.0.67 () {58 vars in 1251 bytes} [Mon Sep 26 18:15:36 2022] GET /compute/v2.1/os-snapshots/1d72d609-cfea-4736-b795-681726b1baf1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:15:36.420469 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-abebf750-72d8-4a5a-a677-588c43722649 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a764b1dc0>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:36.613228 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-abebf750-72d8-4a5a-a677-588c43722649 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f" status: 202 len: 0 microversion: 2.1 time: 0.196895 Sep 26 18:15:36.617458 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 559/1101] 10.222.0.67 () {58 vars in 1248 bytes} [Mon Sep 26 18:15:36 2022] DELETE /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:15:36.622750 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-57f017b2-293d-45c4-88fd-3dab0a1115f7 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a74b4c820>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:36.671464 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-57f017b2-293d-45c4-88fd-3dab0a1115f7 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f" status: 200 len: 345 microversion: 2.1 time: 0.053212 Sep 26 18:15:36.672098 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 543/1102] 10.222.0.67 () {58 vars in 1245 bytes} [Mon Sep 26 18:15:36 2022] GET /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:15:37.687283 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b4baf332-3a66-4815-8452-b3275220cf39 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a74b11940>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:37.714899 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-b4baf332-3a66-4815-8452-b3275220cf39 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] HTTP exception thrown: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b4baf332-3a66-4815-8452-b3275220cf39 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Request method failure captured: Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f HTTP/1.1 Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMexAAVlhqGqs2kBO6CFKAihnGQjEfntBw4segWh_IY5sHu6smuHuI3QIQgtK7kvcZq8p6O96YiFuDMHbE4S1_ZPuBW2VODY_u7hWYrSHYMCB9YbxXzvBOahfCDM5ZHAVCEJb1H2AX3XCNDFTkhoWX-SrFmTx2MdCFKmVchLfCWOeFNo Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: 909137c2da3f40b4bbb1072a22965ada Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1060760586 Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:15:37.716896 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:15:37.718559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/909137c2da3f40b4bbb1072a22965ada"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/909137c2da3f40b4bbb1072a22965ada"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_909137c2da3f40b4bbb1072a22965ada"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/909137c2da3f40b4bbb1072a22965ada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:15:37.718559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1060760586 Sep 26 18:15:37.718559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: 909137c2da3f40b4bbb1072a22965ada Sep 26 18:15:37.718559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1060760586 Sep 26 18:15:37.718559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-VolumesSnapshotsTestJSON-1060760586-project Sep 26 18:15:37.718559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:15:37.718559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:15:37.718559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: ea5d62d563924fcd89427ad0a0166c1b Sep 26 18:15:37.718559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1060760586-project Sep 26 18:15:37.718559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: Sep 26 18:15:37.718559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. Sep 26 18:15:37.718559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': '1691beba-fdcb-4533-8544-8134e75b7c8f'} Sep 26 18:15:37.718559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. (HTTP 404) (Request-ID: req-ad2919b2-dff1-44fd-bddf-e5b864eff8cb) Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:37.719507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 18:15:37.720929 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 18:15:37.722393 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:15:37.724113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. Sep 26 18:15:37.724113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.724113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:37.724113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.724113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:37.724113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:37.724113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:37.724113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:15:37.724113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:15:37.724113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. Sep 26 18:15:37.724113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.724113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b4baf332-3a66-4815-8452-b3275220cf39 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Returning 404 to user: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:15:37.724113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b4baf332-3a66-4815-8452-b3275220cf39 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f" status: 404 len: 109 microversion: 2.1 time: 0.036002 Sep 26 18:15:37.724113 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 560/1103] 10.222.0.67 () {58 vars in 1245 bytes} [Mon Sep 26 18:15:37 2022] GET /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:15:37.733213 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-300aacec-8ffb-47fc-ba92-cd4f49455a0a tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a74a2e670>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:37.761320 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-300aacec-8ffb-47fc-ba92-cd4f49455a0a tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] HTTP exception thrown: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-300aacec-8ffb-47fc-ba92-cd4f49455a0a tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Request method failure captured: Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: DELETE /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f HTTP/1.1 Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMexAAVlhqGqs2kBO6CFKAihnGQjEfntBw4segWh_IY5sHu6smuHuI3QIQgtK7kvcZq8p6O96YiFuDMHbE4S1_ZPuBW2VODY_u7hWYrSHYMCB9YbxXzvBOahfCDM5ZHAVCEJb1H2AX3XCNDFTkhoWX-SrFmTx2MdCFKmVchLfCWOeFNo Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 909137c2da3f40b4bbb1072a22965ada Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1060760586 Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:15:37.763223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:15:37.764885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/909137c2da3f40b4bbb1072a22965ada"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/909137c2da3f40b4bbb1072a22965ada"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_909137c2da3f40b4bbb1072a22965ada"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/909137c2da3f40b4bbb1072a22965ada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:15:37.764885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1060760586 Sep 26 18:15:37.764885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 909137c2da3f40b4bbb1072a22965ada Sep 26 18:15:37.764885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1060760586 Sep 26 18:15:37.764885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-VolumesSnapshotsTestJSON-1060760586-project Sep 26 18:15:37.764885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:15:37.764885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:15:37.764885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: ea5d62d563924fcd89427ad0a0166c1b Sep 26 18:15:37.764885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1060760586-project Sep 26 18:15:37.764885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: Sep 26 18:15:37.764885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. Sep 26 18:15:37.764885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '1691beba-fdcb-4533-8544-8134e75b7c8f'} Sep 26 18:15:37.764885 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. (HTTP 404) (Request-ID: req-e815070d-94da-47b1-ae1d-8b26e3dd4bc9) Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:37.765854 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 18:15:37.767328 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 18:15:37.769550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:15:37.771245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. Sep 26 18:15:37.771245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.771245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:37.771245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.771245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:37.771245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:37.771245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:37.771245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:15:37.771245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:15:37.771245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. Sep 26 18:15:37.771245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.771245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-300aacec-8ffb-47fc-ba92-cd4f49455a0a tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Returning 404 to user: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:15:37.771245 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-300aacec-8ffb-47fc-ba92-cd4f49455a0a tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f" status: 404 len: 109 microversion: 2.1 time: 0.035952 Sep 26 18:15:37.772295 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 544/1104] 10.222.0.67 () {58 vars in 1248 bytes} [Mon Sep 26 18:15:37 2022] DELETE /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 18:15:37.773985 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c8168547-a0f1-4023-b052-3e07aba5ac53 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Calling method '.version_select at 0x7f3a74e59040>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:15:37.802290 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-c8168547-a0f1-4023-b052-3e07aba5ac53 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] HTTP exception thrown: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c8168547-a0f1-4023-b052-3e07aba5ac53 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Request method failure captured: Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f HTTP/1.1 Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMexAAVlhqGqs2kBO6CFKAihnGQjEfntBw4segWh_IY5sHu6smuHuI3QIQgtK7kvcZq8p6O96YiFuDMHbE4S1_ZPuBW2VODY_u7hWYrSHYMCB9YbxXzvBOahfCDM5ZHAVCEJb1H2AX3XCNDFTkhoWX-SrFmTx2MdCFKmVchLfCWOeFNo Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: 909137c2da3f40b4bbb1072a22965ada Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1060760586 Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:15:37.804250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:15:37.805853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/909137c2da3f40b4bbb1072a22965ada"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/909137c2da3f40b4bbb1072a22965ada"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_909137c2da3f40b4bbb1072a22965ada"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/909137c2da3f40b4bbb1072a22965ada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:15:37.805853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1060760586 Sep 26 18:15:37.805853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: 909137c2da3f40b4bbb1072a22965ada Sep 26 18:15:37.805853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1060760586 Sep 26 18:15:37.805853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-VolumesSnapshotsTestJSON-1060760586-project Sep 26 18:15:37.805853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:15:37.805853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:15:37.805853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: ea5d62d563924fcd89427ad0a0166c1b Sep 26 18:15:37.805853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1060760586-project Sep 26 18:15:37.805853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: Sep 26 18:15:37.805853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. Sep 26 18:15:37.805853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': '1691beba-fdcb-4533-8544-8134e75b7c8f'} Sep 26 18:15:37.805853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. (HTTP 404) (Request-ID: req-758fdbbf-e20e-492f-a2cd-c7ed10c13806) Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:37.806729 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 18:15:37.808669 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 18:15:37.810274 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:15:37.811719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. Sep 26 18:15:37.811719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.811719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:15:37.811719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.811719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:15:37.811719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:15:37.811719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:15:37.811719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:15:37.811719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:15:37.811719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. Sep 26 18:15:37.811719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:15:37.811719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-c8168547-a0f1-4023-b052-3e07aba5ac53 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] Returning 404 to user: Volume 1691beba-fdcb-4533-8544-8134e75b7c8f could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:15:37.811719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-c8168547-a0f1-4023-b052-3e07aba5ac53 tempest-VolumesSnapshotsTestJSON-1060760586 tempest-VolumesSnapshotsTestJSON-1060760586-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f" status: 404 len: 109 microversion: 2.1 time: 0.036489 Sep 26 18:15:37.811719 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 561/1105] 10.222.0.67 () {58 vars in 1245 bytes} [Mon Sep 26 18:15:37 2022] GET /compute/v2.1/os-volumes/1691beba-fdcb-4533-8544-8134e75b7c8f => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:16:09.085451 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=3 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:16:09.086203 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=11 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:16:09.092002 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ef69c685-f7f3-4800-9260-795eb8ed6856 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-508849664"}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:16:09.092529 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ef69c685-f7f3-4800-9260-795eb8ed6856 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:16:09.098721 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ef69c685-f7f3-4800-9260-795eb8ed6856 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:09.105322 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ef69c685-f7f3-4800-9260-795eb8ed6856 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:09.105322 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ef69c685-f7f3-4800-9260-795eb8ed6856 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:09.105322 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ef69c685-f7f3-4800-9260-795eb8ed6856 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:09.105322 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ef69c685-f7f3-4800-9260-795eb8ed6856 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:09.105812 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ef69c685-f7f3-4800-9260-795eb8ed6856 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:09.235242 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.network.security_group_api [None req-ef69c685-f7f3-4800-9260-795eb8ed6856 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Removing security group fb4d97e8-fa11-4fa4-b8e3-9eed2b1ec4e6 from port e409e6bd-1f85-4fc8-88ad-e2f42c1ac4f0 Sep 26 18:16:09.592071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ef69c685-f7f3-4800-9260-795eb8ed6856 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "POST /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/action" status: 202 len: 0 microversion: 2.1 time: 0.507923 Sep 26 18:16:09.597674 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 545/1106] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Sep 26 18:16:09 2022] POST /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:16:09.598497 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=7 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:16:09.599188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=35 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:16:09.600398 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 26 18:16:09.605769 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-a9c6353f-8ac3-4b3d-854d-061cb4435f35 req-e7ddd9ae-bf21-4579-b82d-32e8b20f0fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ccf69cd-9bbd-4b64-8623-df51a323a2d5", "tag": "e409e6bd-1f85-4fc8-88ad-e2f42c1ac4f0"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:16:09.617142 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-a9c6353f-8ac3-4b3d-854d-061cb4435f35 req-e7ddd9ae-bf21-4579-b82d-32e8b20f0fa9 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:09.617641 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-a9c6353f-8ac3-4b3d-854d-061cb4435f35 req-e7ddd9ae-bf21-4579-b82d-32e8b20f0fa9 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:09.618415 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-a9c6353f-8ac3-4b3d-854d-061cb4435f35 req-e7ddd9ae-bf21-4579-b82d-32e8b20f0fa9 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:09.631368 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-a9c6353f-8ac3-4b3d-854d-061cb4435f35 req-e7ddd9ae-bf21-4579-b82d-32e8b20f0fa9 service nova] Creating event network-changed:e409e6bd-1f85-4fc8-88ad-e2f42c1ac4f0 for instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 on hv-cinder-85931 Sep 26 18:16:09.637793 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-a9c6353f-8ac3-4b3d-854d-061cb4435f35 req-e7ddd9ae-bf21-4579-b82d-32e8b20f0fa9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041104 Sep 26 18:16:09.639160 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 562/1107] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:16:10.842043 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-92cd9c75-71c6-45fe-9e34-07d9e977073f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:16:10.842043 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-92cd9c75-71c6-45fe-9e34-07d9e977073f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:16:10.845525 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92cd9c75-71c6-45fe-9e34-07d9e977073f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:10.846116 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92cd9c75-71c6-45fe-9e34-07d9e977073f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:10.846630 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92cd9c75-71c6-45fe-9e34-07d9e977073f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:10.847574 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92cd9c75-71c6-45fe-9e34-07d9e977073f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:10.848269 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92cd9c75-71c6-45fe-9e34-07d9e977073f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:10.848892 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-92cd9c75-71c6-45fe-9e34-07d9e977073f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:10.935688 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-92cd9c75-71c6-45fe-9e34-07d9e977073f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lazy-loading 'services' on Instance uuid 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:16:10.968356 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-65b263ed-4e2e-4673-9605-bf2decefaff1 req-17edf8ec-6d64-46a5-9a20-d0d42fdbe2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ccf69cd-9bbd-4b64-8623-df51a323a2d5", "tag": "e409e6bd-1f85-4fc8-88ad-e2f42c1ac4f0"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:16:10.990512 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-65b263ed-4e2e-4673-9605-bf2decefaff1 req-17edf8ec-6d64-46a5-9a20-d0d42fdbe2e8 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:10.991081 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-65b263ed-4e2e-4673-9605-bf2decefaff1 req-17edf8ec-6d64-46a5-9a20-d0d42fdbe2e8 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:10.991597 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-65b263ed-4e2e-4673-9605-bf2decefaff1 req-17edf8ec-6d64-46a5-9a20-d0d42fdbe2e8 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:11.003550 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-65b263ed-4e2e-4673-9605-bf2decefaff1 req-17edf8ec-6d64-46a5-9a20-d0d42fdbe2e8 service nova] Creating event network-changed:e409e6bd-1f85-4fc8-88ad-e2f42c1ac4f0 for instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 on hv-cinder-85931 Sep 26 18:16:11.008426 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-65b263ed-4e2e-4673-9605-bf2decefaff1 req-17edf8ec-6d64-46a5-9a20-d0d42fdbe2e8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179263 Sep 26 18:16:11.009017 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 563/1108] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:16:11.218448 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-92cd9c75-71c6-45fe-9e34-07d9e977073f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments/02d0469d-33d8-479f-8757-c53dd81e37d3" status: 202 len: 0 microversion: 2.1 time: 0.392708 Sep 26 18:16:11.221141 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 546/1109] 10.222.0.67 () {58 vars in 1416 bytes} [Mon Sep 26 18:16:10 2022] DELETE /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments/02d0469d-33d8-479f-8757-c53dd81e37d3 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:16:11.227902 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a7e6b3fb-0b2f-49a4-a627-4fd289a3206f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:16:11.230865 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a7e6b3fb-0b2f-49a4-a627-4fd289a3206f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:16:11.237120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a7e6b3fb-0b2f-49a4-a627-4fd289a3206f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:11.237592 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a7e6b3fb-0b2f-49a4-a627-4fd289a3206f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:11.238055 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a7e6b3fb-0b2f-49a4-a627-4fd289a3206f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:11.238763 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a7e6b3fb-0b2f-49a4-a627-4fd289a3206f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:11.239217 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a7e6b3fb-0b2f-49a4-a627-4fd289a3206f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:11.239677 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a7e6b3fb-0b2f-49a4-a627-4fd289a3206f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:11.270090 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a7e6b3fb-0b2f-49a4-a627-4fd289a3206f tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046451 Sep 26 18:16:11.270652 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 564/1110] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:16:11 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:16:12.283777 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-72be7b69-6561-4e45-91a3-a613443cb2bb tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:16:12.286067 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-72be7b69-6561-4e45-91a3-a613443cb2bb tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:16:12.293071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-72be7b69-6561-4e45-91a3-a613443cb2bb tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:12.293562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-72be7b69-6561-4e45-91a3-a613443cb2bb tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:12.294000 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-72be7b69-6561-4e45-91a3-a613443cb2bb tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:12.294687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-72be7b69-6561-4e45-91a3-a613443cb2bb tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:12.295142 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-72be7b69-6561-4e45-91a3-a613443cb2bb tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:12.295568 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-72be7b69-6561-4e45-91a3-a613443cb2bb tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:12.326550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-72be7b69-6561-4e45-91a3-a613443cb2bb tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047182 Sep 26 18:16:12.327102 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 547/1111] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:16:12 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:16:13.340423 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-74c6f190-baf2-4ff9-b79d-836a8f8488d2 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:16:13.342587 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-74c6f190-baf2-4ff9-b79d-836a8f8488d2 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:16:13.349029 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-74c6f190-baf2-4ff9-b79d-836a8f8488d2 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:13.349516 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-74c6f190-baf2-4ff9-b79d-836a8f8488d2 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:13.349946 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-74c6f190-baf2-4ff9-b79d-836a8f8488d2 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:13.350636 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-74c6f190-baf2-4ff9-b79d-836a8f8488d2 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:13.351089 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-74c6f190-baf2-4ff9-b79d-836a8f8488d2 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:13.351511 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-74c6f190-baf2-4ff9-b79d-836a8f8488d2 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:13.380905 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-74c6f190-baf2-4ff9-b79d-836a8f8488d2 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045877 Sep 26 18:16:13.381457 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 565/1112] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:16:13 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:16:14.394295 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-19d0e6b9-947c-4280-8bd5-c78f1eb0e63b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:16:14.396815 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-19d0e6b9-947c-4280-8bd5-c78f1eb0e63b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:16:14.404224 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-19d0e6b9-947c-4280-8bd5-c78f1eb0e63b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:14.404713 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-19d0e6b9-947c-4280-8bd5-c78f1eb0e63b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:14.405144 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-19d0e6b9-947c-4280-8bd5-c78f1eb0e63b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:14.405846 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-19d0e6b9-947c-4280-8bd5-c78f1eb0e63b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:14.406296 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-19d0e6b9-947c-4280-8bd5-c78f1eb0e63b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:14.406715 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-19d0e6b9-947c-4280-8bd5-c78f1eb0e63b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:14.438597 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-19d0e6b9-947c-4280-8bd5-c78f1eb0e63b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048069 Sep 26 18:16:14.439292 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 548/1113] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:16:14 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:16:15.452362 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-2a4ce33d-8b6c-44d0-bce4-58f81a9e4578 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:16:15.454514 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-2a4ce33d-8b6c-44d0-bce4-58f81a9e4578 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:16:15.461057 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2a4ce33d-8b6c-44d0-bce4-58f81a9e4578 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:15.461531 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2a4ce33d-8b6c-44d0-bce4-58f81a9e4578 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:15.461965 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2a4ce33d-8b6c-44d0-bce4-58f81a9e4578 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:15.463243 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2a4ce33d-8b6c-44d0-bce4-58f81a9e4578 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:15.463796 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2a4ce33d-8b6c-44d0-bce4-58f81a9e4578 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:15.464239 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-2a4ce33d-8b6c-44d0-bce4-58f81a9e4578 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:15.492565 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-2a4ce33d-8b6c-44d0-bce4-58f81a9e4578 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044494 Sep 26 18:16:15.493129 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 566/1114] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Sep 26 18:16:15 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 18:16:15.503913 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1d8c83aa-09b7-442d-89bd-ecb881c459f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:16:15.504451 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1d8c83aa-09b7-442d-89bd-ecb881c459f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:16:15.511441 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1d8c83aa-09b7-442d-89bd-ecb881c459f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:15.511947 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1d8c83aa-09b7-442d-89bd-ecb881c459f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:15.512378 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1d8c83aa-09b7-442d-89bd-ecb881c459f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:15.513090 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1d8c83aa-09b7-442d-89bd-ecb881c459f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:15.513588 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1d8c83aa-09b7-442d-89bd-ecb881c459f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:15.514015 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1d8c83aa-09b7-442d-89bd-ecb881c459f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:15.590186 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-1d8c83aa-09b7-442d-89bd-ecb881c459f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] HTTP exception thrown: Instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 is not attached to volume 02d0469d-33d8-479f-8757-c53dd81e37d3 Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1d8c83aa-09b7-442d-89bd-ecb881c459f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Request method failure captured: Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: DELETE /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments/02d0469d-33d8-479f-8757-c53dd81e37d3 HTTP/1.1 Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMevnvZNfpRnthzgHs7OUjq33zRzgFQBgYlTLyJ8cf-FnSI0ZoilXD0-F_Q7SWWaAebZdC8cjCfsRkMgVfw7h36Fh1-ZmFUD39yad7AVxyYKjMa554S_ck6VUiW5XsUks6b6XrQo9UxYSZeZRRzp48ZebxO0FCCOHKX1swj0qIfqPGM4 Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 3b1fa05de673407eae9d3b50898c7b04 Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-TestMinimumBasicScenario-362049300 Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:16:15.600257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:16:15.602150 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3b1fa05de673407eae9d3b50898c7b04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3b1fa05de673407eae9d3b50898c7b04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3b1fa05de673407eae9d3b50898c7b04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3b1fa05de673407eae9d3b50898c7b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:16:15.602150 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-TestMinimumBasicScenario-362049300 Sep 26 18:16:15.602150 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 3b1fa05de673407eae9d3b50898c7b04 Sep 26 18:16:15.602150 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-TestMinimumBasicScenario-362049300 Sep 26 18:16:15.602150 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-TestMinimumBasicScenario-362049300-project Sep 26 18:16:15.602150 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:16:15.602150 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:16:15.602150 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 97774c7b322e49339d0006640db34e07 Sep 26 18:16:15.602150 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-TestMinimumBasicScenario-362049300-project Sep 26 18:16:15.602150 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:16:15.602150 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 is not attached to volume 02d0469d-33d8-479f-8757-c53dd81e37d3 Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'server_id': '4ccf69cd-9bbd-4b64-8623-df51a323a2d5', 'id': '02d0469d-33d8-479f-8757-c53dd81e37d3'} Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 02d0469d-33d8-479f-8757-c53dd81e37d3. Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:16:15.603184 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:16:15.605463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:16:15.605463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 26 18:16:15.605463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 26 18:16:15.605463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 is not attached to volume 02d0469d-33d8-479f-8757-c53dd81e37d3 Sep 26 18:16:15.605463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:16:15.605463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:16:15.605463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:16:15.605463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:16:15.605463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:16:15.605463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:16:15.605463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:16:15.605463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:16:15.605463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 is not attached to volume 02d0469d-33d8-479f-8757-c53dd81e37d3 Sep 26 18:16:15.605463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:16:15.605463 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1d8c83aa-09b7-442d-89bd-ecb881c459f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Returning 404 to user: Instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 is not attached to volume 02d0469d-33d8-479f-8757-c53dd81e37d3 {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:16:15.606961 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1d8c83aa-09b7-442d-89bd-ecb881c459f1 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments/02d0469d-33d8-479f-8757-c53dd81e37d3" status: 404 len: 154 microversion: 2.1 time: 0.094102 Sep 26 18:16:15.606961 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 549/1115] 10.222.0.67 () {58 vars in 1416 bytes} [Mon Sep 26 18:16:15 2022] DELETE /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5/os-volume_attachments/02d0469d-33d8-479f-8757-c53dd81e37d3 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:16:16.957675 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-30968fa3-9aa8-4dd7-8911-b88a2acadc32 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:16:16.958167 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-30968fa3-9aa8-4dd7-8911-b88a2acadc32 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:16:16.965197 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30968fa3-9aa8-4dd7-8911-b88a2acadc32 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:16.965676 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30968fa3-9aa8-4dd7-8911-b88a2acadc32 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:16.970088 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30968fa3-9aa8-4dd7-8911-b88a2acadc32 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:16.970088 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30968fa3-9aa8-4dd7-8911-b88a2acadc32 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:16.970088 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30968fa3-9aa8-4dd7-8911-b88a2acadc32 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:16.970088 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30968fa3-9aa8-4dd7-8911-b88a2acadc32 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:16.992716 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-30968fa3-9aa8-4dd7-8911-b88a2acadc32 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Going to try to terminate instance {{(pid=121029) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:16:17.373115 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-30968fa3-9aa8-4dd7-8911-b88a2acadc32 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 204 len: 0 microversion: 2.1 time: 0.419115 Sep 26 18:16:17.373693 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 567/1116] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:16:16 2022] DELETE /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:16:17.382085 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-112c8cef-2dd3-45d9-be09-558ed837da50 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:16:17.382702 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-112c8cef-2dd3-45d9-be09-558ed837da50 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:16:17.389804 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-112c8cef-2dd3-45d9-be09-558ed837da50 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:17.390292 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-112c8cef-2dd3-45d9-be09-558ed837da50 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:17.390738 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-112c8cef-2dd3-45d9-be09-558ed837da50 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:17.391432 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-112c8cef-2dd3-45d9-be09-558ed837da50 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:17.392167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-112c8cef-2dd3-45d9-be09-558ed837da50 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:17.392347 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-112c8cef-2dd3-45d9-be09-558ed837da50 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:17.530379 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-112c8cef-2dd3-45d9-be09-558ed837da50 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:16:17.538580 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-112c8cef-2dd3-45d9-be09-558ed837da50 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1552 microversion: 2.1 time: 0.160294 Sep 26 18:16:17.539280 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 550/1117] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:16:17 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:16:18.563233 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-fc7e6882-da3c-42be-8791-22569e146c3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:16:18.563958 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-fc7e6882-da3c-42be-8791-22569e146c3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:16:18.570346 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fc7e6882-da3c-42be-8791-22569e146c3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:18.570826 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fc7e6882-da3c-42be-8791-22569e146c3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:18.571258 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fc7e6882-da3c-42be-8791-22569e146c3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:18.572265 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fc7e6882-da3c-42be-8791-22569e146c3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:18.572469 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fc7e6882-da3c-42be-8791-22569e146c3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:18.572895 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-fc7e6882-da3c-42be-8791-22569e146c3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:18.709498 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-fc7e6882-da3c-42be-8791-22569e146c3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:16:18.717515 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-fc7e6882-da3c-42be-8791-22569e146c3b tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1552 microversion: 2.1 time: 0.158529 Sep 26 18:16:18.718083 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 568/1118] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:16:18 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:16:19.740841 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-c08742d1-5be6-4574-b160-047d5cb20ddf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:16:19.741475 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-c08742d1-5be6-4574-b160-047d5cb20ddf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:16:19.749039 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c08742d1-5be6-4574-b160-047d5cb20ddf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:19.749514 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c08742d1-5be6-4574-b160-047d5cb20ddf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:19.749940 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c08742d1-5be6-4574-b160-047d5cb20ddf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:19.750642 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c08742d1-5be6-4574-b160-047d5cb20ddf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:19.751089 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c08742d1-5be6-4574-b160-047d5cb20ddf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:19.751508 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-c08742d1-5be6-4574-b160-047d5cb20ddf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:19.839045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-c08742d1-5be6-4574-b160-047d5cb20ddf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:16:19.847005 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-c08742d1-5be6-4574-b160-047d5cb20ddf tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1510 microversion: 2.1 time: 0.110218 Sep 26 18:16:19.860725 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 551/1119] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:16:19 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1510 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:16:19.887188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-419bc2f9-ee0e-4e64-8922-2b86ff58151e req-8be3e495-b07f-4fd8-b86e-ceae4e17dc32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ccf69cd-9bbd-4b64-8623-df51a323a2d5", "name": "network-vif-deleted", "tag": "e409e6bd-1f85-4fc8-88ad-e2f42c1ac4f0"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:16:19.897640 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-419bc2f9-ee0e-4e64-8922-2b86ff58151e req-8be3e495-b07f-4fd8-b86e-ceae4e17dc32 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:19.898120 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-419bc2f9-ee0e-4e64-8922-2b86ff58151e req-8be3e495-b07f-4fd8-b86e-ceae4e17dc32 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:19.898549 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-419bc2f9-ee0e-4e64-8922-2b86ff58151e req-8be3e495-b07f-4fd8-b86e-ceae4e17dc32 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:19.910333 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-419bc2f9-ee0e-4e64-8922-2b86ff58151e req-8be3e495-b07f-4fd8-b86e-ceae4e17dc32 service nova] Creating event network-vif-deleted:e409e6bd-1f85-4fc8-88ad-e2f42c1ac4f0 for instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 on hv-cinder-85931 Sep 26 18:16:19.915349 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-419bc2f9-ee0e-4e64-8922-2b86ff58151e req-8be3e495-b07f-4fd8-b86e-ceae4e17dc32 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032526 Sep 26 18:16:19.921282 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 569/1120] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:16:20.871152 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1974e70f-7914-4742-9d15-4ddfdc14bf27 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:16:20.871798 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1974e70f-7914-4742-9d15-4ddfdc14bf27 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:16:20.878395 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1974e70f-7914-4742-9d15-4ddfdc14bf27 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:20.878872 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1974e70f-7914-4742-9d15-4ddfdc14bf27 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:20.879303 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1974e70f-7914-4742-9d15-4ddfdc14bf27 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:20.880025 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1974e70f-7914-4742-9d15-4ddfdc14bf27 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:20.880486 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1974e70f-7914-4742-9d15-4ddfdc14bf27 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:20.880907 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1974e70f-7914-4742-9d15-4ddfdc14bf27 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:20.911878 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1974e70f-7914-4742-9d15-4ddfdc14bf27 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:20.913019 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1974e70f-7914-4742-9d15-4ddfdc14bf27 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:20.913019 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1974e70f-7914-4742-9d15-4ddfdc14bf27 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:20.913218 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-1974e70f-7914-4742-9d15-4ddfdc14bf27 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lazy-loading 'fault' on Instance uuid 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:16:20.954920 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1974e70f-7914-4742-9d15-4ddfdc14bf27 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:16:20.962950 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1974e70f-7914-4742-9d15-4ddfdc14bf27 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1347 microversion: 2.1 time: 0.096602 Sep 26 18:16:20.963518 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 552/1121] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:16:20 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1347 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:16:21.987219 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-3932b2cf-d8f0-4fd6-9870-b2f588569e8d tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:16:21.987943 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-3932b2cf-d8f0-4fd6-9870-b2f588569e8d tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:16:21.995001 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3932b2cf-d8f0-4fd6-9870-b2f588569e8d tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:21.995482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3932b2cf-d8f0-4fd6-9870-b2f588569e8d tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:21.995950 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3932b2cf-d8f0-4fd6-9870-b2f588569e8d tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:21.996646 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3932b2cf-d8f0-4fd6-9870-b2f588569e8d tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:21.997099 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3932b2cf-d8f0-4fd6-9870-b2f588569e8d tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:21.997525 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3932b2cf-d8f0-4fd6-9870-b2f588569e8d tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:22.028747 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3932b2cf-d8f0-4fd6-9870-b2f588569e8d tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:22.029229 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3932b2cf-d8f0-4fd6-9870-b2f588569e8d tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:22.029660 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-3932b2cf-d8f0-4fd6-9870-b2f588569e8d tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:22.030118 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-3932b2cf-d8f0-4fd6-9870-b2f588569e8d tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lazy-loading 'fault' on Instance uuid 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:16:22.075763 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-3932b2cf-d8f0-4fd6-9870-b2f588569e8d tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:16:22.084000 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-3932b2cf-d8f0-4fd6-9870-b2f588569e8d tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1347 microversion: 2.1 time: 0.101016 Sep 26 18:16:22.084567 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 570/1122] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:16:21 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1347 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:16:23.108995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-02d2e268-d188-4474-bf08-15f510aec01a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:16:23.109598 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-02d2e268-d188-4474-bf08-15f510aec01a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:16:23.116523 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-02d2e268-d188-4474-bf08-15f510aec01a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:23.119454 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-02d2e268-d188-4474-bf08-15f510aec01a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:23.119454 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-02d2e268-d188-4474-bf08-15f510aec01a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:23.119454 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-02d2e268-d188-4474-bf08-15f510aec01a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:23.119454 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-02d2e268-d188-4474-bf08-15f510aec01a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:23.119853 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-02d2e268-d188-4474-bf08-15f510aec01a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:23.151892 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-02d2e268-d188-4474-bf08-15f510aec01a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:23.152381 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-02d2e268-d188-4474-bf08-15f510aec01a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:23.152858 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-02d2e268-d188-4474-bf08-15f510aec01a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:23.153309 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-02d2e268-d188-4474-bf08-15f510aec01a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lazy-loading 'fault' on Instance uuid 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:16:23.193636 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-02d2e268-d188-4474-bf08-15f510aec01a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97774c7b322e49339d0006640db34e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1fa05de673407eae9d3b50898c7b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:16:23.202226 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-02d2e268-d188-4474-bf08-15f510aec01a tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 200 len: 1347 microversion: 2.1 time: 0.097237 Sep 26 18:16:23.202840 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 553/1123] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:16:23 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 1347 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:16:24.226138 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-4e561205-ff5c-461e-85da-84d8d7f29e4c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:16:24.226841 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-4e561205-ff5c-461e-85da-84d8d7f29e4c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] [instance: 4ccf69cd-9bbd-4b64-8623-df51a323a2d5] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:16:24.234404 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4e561205-ff5c-461e-85da-84d8d7f29e4c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:24.234894 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4e561205-ff5c-461e-85da-84d8d7f29e4c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:24.235339 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4e561205-ff5c-461e-85da-84d8d7f29e4c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:24.236066 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4e561205-ff5c-461e-85da-84d8d7f29e4c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:16:24.236527 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4e561205-ff5c-461e-85da-84d8d7f29e4c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:16:24.236952 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4e561205-ff5c-461e-85da-84d8d7f29e4c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:16:24.250708 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-4e561205-ff5c-461e-85da-84d8d7f29e4c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] HTTP exception thrown: Instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 could not be found. Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-4e561205-ff5c-461e-85da-84d8d7f29e4c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Request method failure captured: Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 HTTP/1.1 Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMevnvZNfpRnthzgHs7OUjq33zRzgFQBgYlTLyJ8cf-FnSI0ZoilXD0-F_Q7SWWaAebZdC8cjCfsRkMgVfw7h36Fh1-ZmFUD39yad7AVxyYKjMa554S_ck6VUiW5XsUks6b6XrQo9UxYSZeZRRzp48ZebxO0FCCOHKX1swj0qIfqPGM4 Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: 3b1fa05de673407eae9d3b50898c7b04 Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-TestMinimumBasicScenario-362049300 Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:16:24.257086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:16:24.258570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3b1fa05de673407eae9d3b50898c7b04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3b1fa05de673407eae9d3b50898c7b04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3b1fa05de673407eae9d3b50898c7b04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3b1fa05de673407eae9d3b50898c7b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:16:24.258570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-TestMinimumBasicScenario-362049300 Sep 26 18:16:24.258570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: 3b1fa05de673407eae9d3b50898c7b04 Sep 26 18:16:24.258570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-TestMinimumBasicScenario-362049300 Sep 26 18:16:24.258570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-TestMinimumBasicScenario-362049300-project Sep 26 18:16:24.258570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:16:24.258570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:16:24.258570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 97774c7b322e49339d0006640db34e07 Sep 26 18:16:24.258570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-TestMinimumBasicScenario-362049300-project Sep 26 18:16:24.258570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:16:24.258570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 could not be found. Sep 26 18:16:24.258570 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': '4ccf69cd-9bbd-4b64-8623-df51a323a2d5'} Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 could not be found. Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:16:24.259437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 could not be found. Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 could not be found. Sep 26 18:16:24.260872 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:16:24.262175 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-4e561205-ff5c-461e-85da-84d8d7f29e4c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Returning 404 to user: Instance 4ccf69cd-9bbd-4b64-8623-df51a323a2d5 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:16:24.262175 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-4e561205-ff5c-461e-85da-84d8d7f29e4c tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5" status: 404 len: 111 microversion: 2.1 time: 0.031588 Sep 26 18:16:24.262175 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 571/1124] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:16:24 2022] GET /compute/v2.1/servers/4ccf69cd-9bbd-4b64-8623-df51a323a2d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:16:24.262682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f42448b8-b69a-4304-9691-13a4080badf7 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] Calling method '.version_select at 0x7f3a74b0c670>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:16:24.408759 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f42448b8-b69a-4304-9691-13a4080badf7 tempest-TestMinimumBasicScenario-362049300 tempest-TestMinimumBasicScenario-362049300-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-737834352" status: 202 len: 0 microversion: 2.1 time: 0.149896 Sep 26 18:16:24.409336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 554/1125] 10.222.0.67 () {58 vars in 1269 bytes} [Mon Sep 26 18:16:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-737834352 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 18:16:48.119297 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:16:48.120734 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:16:48.328612 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7cbb7dce-3855-4fba-a308-b2f8214cbf24 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Action: 'create', calling method: .version_select at 0x7f3a74c84310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-7185126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuVQZdjZAHak3fEWjGxd778FPQUxxNNBL69WZrf9T5BavVJ/mnCva2tQUrD2dYBEG2oYu359h5ugLy8UdPb5bfZtNKth3SjKu1voyRlccCE4A+YJZt3xa/sQHsSKmspdQ=="}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:16:48.344030 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-7cbb7dce-3855-4fba-a308-b2f8214cbf24 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Getting quotas for project 54bca4cc170d4e3fbad17be586081bc0. Resources: {'key_pairs'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:16:48.348033 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-7cbb7dce-3855-4fba-a308-b2f8214cbf24 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Getting quotas for user 8d96b8d565f94e68a705691a5ec64e04 and project 54bca4cc170d4e3fbad17be586081bc0. Resources: {'key_pairs'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:16:48.408538 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7cbb7dce-3855-4fba-a308-b2f8214cbf24 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.296504 Sep 26 18:16:48.409140 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 572/1126] 10.222.0.67 () {60 vars in 1159 bytes} [Mon Sep 26 18:16:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:17:06.454216 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-31363543", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-7185126", "security_groups": [{"name": "tempest-secgroup-smoke-544660154"}], "block_device_mapping_v2": [{"uuid": "cc4af79f-305f-430b-bc5c-089f18ffaa71", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ba9a025-fbef-406e-aa56-d82e69f22721"}]}} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:17:06.466167 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:17:06.466844 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:17:06.570834 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.network.neutron [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] validate_networks() for [('5ba9a025-fbef-406e-aa56-d82e69f22721', None, None, None, None, None)] {{(pid=121028) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:17:07.053809 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Flavor limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:17:07.054236 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Image limits 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:17:07.055251 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Flavor pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:17:07.055699 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Image pref 0:0:0 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:17:07.056293 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.virt.hardware [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:17:07.065507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:07.066001 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:07.066438 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:07.067226 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:07.067671 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:07.068101 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:07.085606 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Getting quotas for project 54bca4cc170d4e3fbad17be586081bc0. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:17:07.089641 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.quota [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Getting quotas for user 8d96b8d565f94e68a705691a5ec64e04 and project 54bca4cc170d4e3fbad17be586081bc0. Resources: {'ram', 'cores', 'instances'} {{(pid=121028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:17:07.148218 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Going to run 1 instances... {{(pid=121028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:17:07.150664 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc4af79f-305f-430b-bc5c-089f18ffaa71',volume_size=None,volume_type=None)] {{(pid=121028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:17:07.550029 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR oslo.messaging._drivers.impl_rabbit [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [104a695a-3b69-4db1-957c-e22e1776be26] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 26 18:17:08.557678 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO oslo.messaging._drivers.impl_rabbit [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [104a695a-3b69-4db1-957c-e22e1776be26] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 51542. Sep 26 18:17:08.562120 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-01d12e26-fef3-4a11-a5c4-05a417dd7827 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.111860 Sep 26 18:17:08.562757 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 555/1127] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:17:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 2113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:17:08.571602 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=4 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:17:08.572374 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:17:08.576415 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-2aaf4ce0-6fb5-4dbf-937c-9782367a1eda tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:08.584145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-2aaf4ce0-6fb5-4dbf-937c-9782367a1eda tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:08.634201 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-2aaf4ce0-6fb5-4dbf-937c-9782367a1eda tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:08.642026 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-2aaf4ce0-6fb5-4dbf-937c-9782367a1eda tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1090 microversion: 2.1 time: 0.071791 Sep 26 18:17:08.642678 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 573/1128] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:08 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1090 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:09.666452 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-044afac2-baea-414b-a0db-f8d499b42013 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:09.667061 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-044afac2-baea-414b-a0db-f8d499b42013 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:09.730251 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-044afac2-baea-414b-a0db-f8d499b42013 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:09.737188 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-044afac2-baea-414b-a0db-f8d499b42013 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1090 microversion: 2.1 time: 0.075292 Sep 26 18:17:09.743192 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 556/1129] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:09 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1090 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:10.761332 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-30328249-c843-49c0-9504-b8edf247c52c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:10.761944 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-30328249-c843-49c0-9504-b8edf247c52c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:10.768381 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30328249-c843-49c0-9504-b8edf247c52c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:10.768870 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30328249-c843-49c0-9504-b8edf247c52c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:10.769301 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30328249-c843-49c0-9504-b8edf247c52c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:10.769995 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30328249-c843-49c0-9504-b8edf247c52c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:10.770454 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30328249-c843-49c0-9504-b8edf247c52c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:10.770877 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-30328249-c843-49c0-9504-b8edf247c52c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:10.833704 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-30328249-c843-49c0-9504-b8edf247c52c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:10.841531 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-30328249-c843-49c0-9504-b8edf247c52c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1188 microversion: 2.1 time: 0.085573 Sep 26 18:17:10.842086 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 574/1130] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:10 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:11.863834 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-15be09c3-8aea-4c80-a27c-70186901de6d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:11.864401 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-15be09c3-8aea-4c80-a27c-70186901de6d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:11.872377 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15be09c3-8aea-4c80-a27c-70186901de6d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:11.872976 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15be09c3-8aea-4c80-a27c-70186901de6d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:11.873406 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15be09c3-8aea-4c80-a27c-70186901de6d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:11.874097 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15be09c3-8aea-4c80-a27c-70186901de6d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:11.874548 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15be09c3-8aea-4c80-a27c-70186901de6d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:11.874964 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-15be09c3-8aea-4c80-a27c-70186901de6d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:11.938175 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-15be09c3-8aea-4c80-a27c-70186901de6d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:11.946926 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-15be09c3-8aea-4c80-a27c-70186901de6d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1206 microversion: 2.1 time: 0.087173 Sep 26 18:17:11.947710 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 557/1131] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:11 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1206 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:12.971250 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-28e026be-6b4e-4fe4-915c-c61e61903875 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:12.971889 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-28e026be-6b4e-4fe4-915c-c61e61903875 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:12.979835 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28e026be-6b4e-4fe4-915c-c61e61903875 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:12.980335 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28e026be-6b4e-4fe4-915c-c61e61903875 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:12.980774 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28e026be-6b4e-4fe4-915c-c61e61903875 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:12.981478 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28e026be-6b4e-4fe4-915c-c61e61903875 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:12.981934 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28e026be-6b4e-4fe4-915c-c61e61903875 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:12.982354 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-28e026be-6b4e-4fe4-915c-c61e61903875 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:13.027678 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-18aaee3e-521b-4ba2-b14d-4943b8f8e072 req-8c7291b2-cb3c-4556-84d6-9b31155d49a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9a3691-e877-45a2-9a0a-5f13beb60456", "tag": "16bd7397-f015-4e5f-a7dd-26ae2d5b08bc"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:17:13.038009 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-18aaee3e-521b-4ba2-b14d-4943b8f8e072 req-8c7291b2-cb3c-4556-84d6-9b31155d49a7 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:13.038442 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-18aaee3e-521b-4ba2-b14d-4943b8f8e072 req-8c7291b2-cb3c-4556-84d6-9b31155d49a7 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:13.038927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-18aaee3e-521b-4ba2-b14d-4943b8f8e072 req-8c7291b2-cb3c-4556-84d6-9b31155d49a7 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:13.052045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-18aaee3e-521b-4ba2-b14d-4943b8f8e072 req-8c7291b2-cb3c-4556-84d6-9b31155d49a7 service nova] Creating event network-changed:16bd7397-f015-4e5f-a7dd-26ae2d5b08bc for instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 on hv-cinder-85931 Sep 26 18:17:13.057550 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-18aaee3e-521b-4ba2-b14d-4943b8f8e072 req-8c7291b2-cb3c-4556-84d6-9b31155d49a7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035825 Sep 26 18:17:13.058154 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 558/1132] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:17:13.222928 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-28e026be-6b4e-4fe4-915c-c61e61903875 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:13.231594 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-28e026be-6b4e-4fe4-915c-c61e61903875 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1261 microversion: 2.1 time: 0.264261 Sep 26 18:17:13.232203 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 575/1133] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:12 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1261 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:14.256577 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f6a57b70-9ee9-4a8d-99b1-93050fc07425 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:14.257218 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f6a57b70-9ee9-4a8d-99b1-93050fc07425 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:14.263569 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f6a57b70-9ee9-4a8d-99b1-93050fc07425 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:14.264091 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f6a57b70-9ee9-4a8d-99b1-93050fc07425 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:14.264538 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f6a57b70-9ee9-4a8d-99b1-93050fc07425 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:14.265225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f6a57b70-9ee9-4a8d-99b1-93050fc07425 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:14.265686 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f6a57b70-9ee9-4a8d-99b1-93050fc07425 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:14.266109 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f6a57b70-9ee9-4a8d-99b1-93050fc07425 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:14.399544 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f6a57b70-9ee9-4a8d-99b1-93050fc07425 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:14.408104 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f6a57b70-9ee9-4a8d-99b1-93050fc07425 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1261 microversion: 2.1 time: 0.156256 Sep 26 18:17:14.413046 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 559/1134] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:14 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:15.432441 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-acd1182e-b25d-49b6-9eb6-c5a52f2656c6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:15.433081 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-acd1182e-b25d-49b6-9eb6-c5a52f2656c6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:15.439634 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-acd1182e-b25d-49b6-9eb6-c5a52f2656c6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:15.440150 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-acd1182e-b25d-49b6-9eb6-c5a52f2656c6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:15.440792 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-acd1182e-b25d-49b6-9eb6-c5a52f2656c6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:15.441999 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-acd1182e-b25d-49b6-9eb6-c5a52f2656c6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:15.442806 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-acd1182e-b25d-49b6-9eb6-c5a52f2656c6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:15.443556 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-acd1182e-b25d-49b6-9eb6-c5a52f2656c6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:15.590668 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-acd1182e-b25d-49b6-9eb6-c5a52f2656c6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:15.598340 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-acd1182e-b25d-49b6-9eb6-c5a52f2656c6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1261 microversion: 2.1 time: 0.170611 Sep 26 18:17:15.598897 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 576/1135] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:15 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:16.620726 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-56f5b373-9123-46a3-b4ae-82425b3eb51d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:16.621340 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-56f5b373-9123-46a3-b4ae-82425b3eb51d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:16.627800 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-56f5b373-9123-46a3-b4ae-82425b3eb51d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:16.628280 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-56f5b373-9123-46a3-b4ae-82425b3eb51d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:16.628709 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-56f5b373-9123-46a3-b4ae-82425b3eb51d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:16.629397 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-56f5b373-9123-46a3-b4ae-82425b3eb51d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:16.629846 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-56f5b373-9123-46a3-b4ae-82425b3eb51d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:16.630267 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-56f5b373-9123-46a3-b4ae-82425b3eb51d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:16.761791 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-56f5b373-9123-46a3-b4ae-82425b3eb51d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:16.770816 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-56f5b373-9123-46a3-b4ae-82425b3eb51d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1261 microversion: 2.1 time: 0.154006 Sep 26 18:17:16.771389 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 560/1136] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:16 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:17.794792 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-47080958-9d38-45e4-bfdb-2a034bcb5684 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:17.795424 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-47080958-9d38-45e4-bfdb-2a034bcb5684 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:17.797688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 18:17:17.797857 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Mon Sep 26 18:17:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 (ip 10.222.0.67) !!! Sep 26 18:17:17.805913 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-47080958-9d38-45e4-bfdb-2a034bcb5684 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:17.806406 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-47080958-9d38-45e4-bfdb-2a034bcb5684 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:17.806843 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-47080958-9d38-45e4-bfdb-2a034bcb5684 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:17.807538 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-47080958-9d38-45e4-bfdb-2a034bcb5684 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:17.808023 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-47080958-9d38-45e4-bfdb-2a034bcb5684 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:17.808449 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-47080958-9d38-45e4-bfdb-2a034bcb5684 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:17.940609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-47080958-9d38-45e4-bfdb-2a034bcb5684 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:17.948803 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-47080958-9d38-45e4-bfdb-2a034bcb5684 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1261 microversion: 2.1 time: 0.157849 Sep 26 18:17:17.949367 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 577/1137] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:17 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:18.972256 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-292da9b1-7353-4782-82f6-1746b6846c8e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:18.972810 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-292da9b1-7353-4782-82f6-1746b6846c8e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:18.974738 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=2 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:17:18.981152 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-292da9b1-7353-4782-82f6-1746b6846c8e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:18.981646 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-292da9b1-7353-4782-82f6-1746b6846c8e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:18.982085 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-292da9b1-7353-4782-82f6-1746b6846c8e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:18.982785 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-292da9b1-7353-4782-82f6-1746b6846c8e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:18.983270 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-292da9b1-7353-4782-82f6-1746b6846c8e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:18.983864 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-292da9b1-7353-4782-82f6-1746b6846c8e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:19.118051 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-292da9b1-7353-4782-82f6-1746b6846c8e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:19.125753 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-292da9b1-7353-4782-82f6-1746b6846c8e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1261 microversion: 2.1 time: 0.157428 Sep 26 18:17:19.126315 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 561/1138] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:18 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:20.148704 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-26cc0310-dd5d-41b5-bf30-af7762a21bcc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:20.149327 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-26cc0310-dd5d-41b5-bf30-af7762a21bcc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:20.151195 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:17:20.156437 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26cc0310-dd5d-41b5-bf30-af7762a21bcc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:20.156914 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26cc0310-dd5d-41b5-bf30-af7762a21bcc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:20.157346 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26cc0310-dd5d-41b5-bf30-af7762a21bcc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:20.158030 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26cc0310-dd5d-41b5-bf30-af7762a21bcc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:20.158479 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26cc0310-dd5d-41b5-bf30-af7762a21bcc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:20.158899 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-26cc0310-dd5d-41b5-bf30-af7762a21bcc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:20.290573 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-26cc0310-dd5d-41b5-bf30-af7762a21bcc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:20.298213 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-26cc0310-dd5d-41b5-bf30-af7762a21bcc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1261 microversion: 2.1 time: 0.153898 Sep 26 18:17:20.298771 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 578/1139] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:20 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:21.322411 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-dff4b8f8-1154-4442-952c-2d043c088103 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:21.323077 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-dff4b8f8-1154-4442-952c-2d043c088103 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:21.325043 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=8 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:17:21.330194 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dff4b8f8-1154-4442-952c-2d043c088103 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:21.330688 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dff4b8f8-1154-4442-952c-2d043c088103 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:21.331103 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dff4b8f8-1154-4442-952c-2d043c088103 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:21.331814 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dff4b8f8-1154-4442-952c-2d043c088103 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:21.332264 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dff4b8f8-1154-4442-952c-2d043c088103 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:21.332680 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-dff4b8f8-1154-4442-952c-2d043c088103 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:21.469107 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-dff4b8f8-1154-4442-952c-2d043c088103 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:21.478108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-dff4b8f8-1154-4442-952c-2d043c088103 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1261 microversion: 2.1 time: 0.160347 Sep 26 18:17:21.478680 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 562/1140] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:21 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:22.501419 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9ec7543d-8385-4952-a37a-ec7ae09050dc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:22.502003 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9ec7543d-8385-4952-a37a-ec7ae09050dc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:22.508679 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9ec7543d-8385-4952-a37a-ec7ae09050dc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:22.509163 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9ec7543d-8385-4952-a37a-ec7ae09050dc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:22.509598 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9ec7543d-8385-4952-a37a-ec7ae09050dc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:22.510291 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9ec7543d-8385-4952-a37a-ec7ae09050dc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:22.510743 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9ec7543d-8385-4952-a37a-ec7ae09050dc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:22.511169 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9ec7543d-8385-4952-a37a-ec7ae09050dc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:22.643805 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9ec7543d-8385-4952-a37a-ec7ae09050dc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:22.653187 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9ec7543d-8385-4952-a37a-ec7ae09050dc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1261 microversion: 2.1 time: 0.155687 Sep 26 18:17:22.653762 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 579/1141] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:22 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:23.676039 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-42898019-8c13-4033-9ada-7dff9135ff89 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:23.676648 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-42898019-8c13-4033-9ada-7dff9135ff89 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:23.683293 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-42898019-8c13-4033-9ada-7dff9135ff89 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:23.683805 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-42898019-8c13-4033-9ada-7dff9135ff89 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:23.684246 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-42898019-8c13-4033-9ada-7dff9135ff89 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:23.685711 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-42898019-8c13-4033-9ada-7dff9135ff89 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:23.686229 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-42898019-8c13-4033-9ada-7dff9135ff89 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:23.686692 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-42898019-8c13-4033-9ada-7dff9135ff89 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:23.823144 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-7b5fcd06-bab8-4173-802b-a71c2ae4e556 req-aa1eb2a2-9519-405d-9826-d420dadc65ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9a3691-e877-45a2-9a0a-5f13beb60456", "name": "network-vif-plugged", "status": "completed", "tag": "16bd7397-f015-4e5f-a7dd-26ae2d5b08bc"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:17:23.824951 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-42898019-8c13-4033-9ada-7dff9135ff89 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:23.833336 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-7b5fcd06-bab8-4173-802b-a71c2ae4e556 req-aa1eb2a2-9519-405d-9826-d420dadc65ff service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:23.833493 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-42898019-8c13-4033-9ada-7dff9135ff89 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1261 microversion: 2.1 time: 0.161224 Sep 26 18:17:23.833944 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-7b5fcd06-bab8-4173-802b-a71c2ae4e556 req-aa1eb2a2-9519-405d-9826-d420dadc65ff service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:23.834074 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 563/1142] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:23 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:23.834414 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-7b5fcd06-bab8-4173-802b-a71c2ae4e556 req-aa1eb2a2-9519-405d-9826-d420dadc65ff service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:23.846244 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-7b5fcd06-bab8-4173-802b-a71c2ae4e556 req-aa1eb2a2-9519-405d-9826-d420dadc65ff service nova] Creating event network-vif-plugged:16bd7397-f015-4e5f-a7dd-26ae2d5b08bc for instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 on hv-cinder-85931 Sep 26 18:17:23.851632 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-7b5fcd06-bab8-4173-802b-a71c2ae4e556 req-aa1eb2a2-9519-405d-9826-d420dadc65ff service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032737 Sep 26 18:17:23.852309 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 580/1143] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:17:24.860883 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-7fc20d8a-7c9e-4d81-a31b-320a2a3f1244 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:24.861484 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-7fc20d8a-7c9e-4d81-a31b-320a2a3f1244 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:24.868360 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7fc20d8a-7c9e-4d81-a31b-320a2a3f1244 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:24.868845 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7fc20d8a-7c9e-4d81-a31b-320a2a3f1244 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:24.869280 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7fc20d8a-7c9e-4d81-a31b-320a2a3f1244 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:24.869972 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7fc20d8a-7c9e-4d81-a31b-320a2a3f1244 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:24.870447 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7fc20d8a-7c9e-4d81-a31b-320a2a3f1244 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:24.870871 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7fc20d8a-7c9e-4d81-a31b-320a2a3f1244 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:25.014257 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-7fc20d8a-7c9e-4d81-a31b-320a2a3f1244 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:25.016501 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-7fc20d8a-7c9e-4d81-a31b-320a2a3f1244 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1261 microversion: 2.1 time: 0.159569 Sep 26 18:17:25.017064 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 564/1144] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:24 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:26.041534 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-60c47d40-bf0d-4762-a245-19ab501d53af tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:26.042237 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-60c47d40-bf0d-4762-a245-19ab501d53af tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:26.048358 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-60c47d40-bf0d-4762-a245-19ab501d53af tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:26.048944 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-60c47d40-bf0d-4762-a245-19ab501d53af tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:26.049384 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-60c47d40-bf0d-4762-a245-19ab501d53af tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:26.050075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-60c47d40-bf0d-4762-a245-19ab501d53af tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:26.050533 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-60c47d40-bf0d-4762-a245-19ab501d53af tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:26.050959 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-60c47d40-bf0d-4762-a245-19ab501d53af tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:26.184789 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-60c47d40-bf0d-4762-a245-19ab501d53af tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:26.192527 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-60c47d40-bf0d-4762-a245-19ab501d53af tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1448 microversion: 2.1 time: 0.156135 Sep 26 18:17:26.193079 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 581/1145] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:26 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1448 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:26.215638 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-64924190-59a2-4aaa-babe-9ee1bee47e9a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:17:26.216223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-64924190-59a2-4aaa-babe-9ee1bee47e9a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:17:26.222732 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-64924190-59a2-4aaa-babe-9ee1bee47e9a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:26.223211 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-64924190-59a2-4aaa-babe-9ee1bee47e9a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:26.223640 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-64924190-59a2-4aaa-babe-9ee1bee47e9a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:26.224344 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-64924190-59a2-4aaa-babe-9ee1bee47e9a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:26.224798 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-64924190-59a2-4aaa-babe-9ee1bee47e9a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:26.225211 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-64924190-59a2-4aaa-babe-9ee1bee47e9a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:26.359149 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-64924190-59a2-4aaa-babe-9ee1bee47e9a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:17:26.367429 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-64924190-59a2-4aaa-babe-9ee1bee47e9a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1448 microversion: 2.1 time: 0.155255 Sep 26 18:17:26.368092 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 565/1146] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:17:26 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:17:28.697578 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-e88f73a2-b5bf-4eca-8e68-9ee7ccea7d02 req-33006ba1-6f72-4397-8677-d0afa89a0764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9a3691-e877-45a2-9a0a-5f13beb60456", "tag": "16bd7397-f015-4e5f-a7dd-26ae2d5b08bc"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:17:28.710220 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-e88f73a2-b5bf-4eca-8e68-9ee7ccea7d02 req-33006ba1-6f72-4397-8677-d0afa89a0764 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:17:28.710971 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-e88f73a2-b5bf-4eca-8e68-9ee7ccea7d02 req-33006ba1-6f72-4397-8677-d0afa89a0764 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:17:28.711765 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-e88f73a2-b5bf-4eca-8e68-9ee7ccea7d02 req-33006ba1-6f72-4397-8677-d0afa89a0764 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:17:28.724350 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-e88f73a2-b5bf-4eca-8e68-9ee7ccea7d02 req-33006ba1-6f72-4397-8677-d0afa89a0764 service nova] Creating event network-changed:16bd7397-f015-4e5f-a7dd-26ae2d5b08bc for instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 on hv-cinder-85931 Sep 26 18:17:28.731320 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-e88f73a2-b5bf-4eca-8e68-9ee7ccea7d02 req-33006ba1-6f72-4397-8677-d0afa89a0764 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045829 Sep 26 18:17:28.732239 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 582/1147] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:19:23.769151 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:19:23.769906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=52 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:19:23.771683 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 18:19:23.771822 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Mon Sep 26 18:19:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 (ip 10.222.0.67) !!! Sep 26 18:19:23.776665 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f4ac514f-f447-477e-9067-90cb847176ce tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:23.777157 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f4ac514f-f447-477e-9067-90cb847176ce tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:23.783811 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f4ac514f-f447-477e-9067-90cb847176ce tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:23.784294 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f4ac514f-f447-477e-9067-90cb847176ce tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:23.784728 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f4ac514f-f447-477e-9067-90cb847176ce tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:23.785504 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f4ac514f-f447-477e-9067-90cb847176ce tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:23.785961 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f4ac514f-f447-477e-9067-90cb847176ce tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:23.786385 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f4ac514f-f447-477e-9067-90cb847176ce tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:23.813199 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f4ac514f-f447-477e-9067-90cb847176ce tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Going to try to terminate instance {{(pid=121028) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:19:24.096936 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f4ac514f-f447-477e-9067-90cb847176ce tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 204 len: 0 microversion: 2.1 time: 0.329406 Sep 26 18:19:24.097434 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 566/1148] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:19:23 2022] DELETE /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:19:24.104283 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=22 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:19:24.105026 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=46 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:19:24.111338 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-aa31b3d6-0472-49ce-bffb-a9bbeb24281f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:24.112307 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-aa31b3d6-0472-49ce-bffb-a9bbeb24281f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:24.118384 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-aa31b3d6-0472-49ce-bffb-a9bbeb24281f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:24.118867 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-aa31b3d6-0472-49ce-bffb-a9bbeb24281f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:24.119309 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-aa31b3d6-0472-49ce-bffb-a9bbeb24281f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:24.120065 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-aa31b3d6-0472-49ce-bffb-a9bbeb24281f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:24.120527 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-aa31b3d6-0472-49ce-bffb-a9bbeb24281f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:24.120953 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-aa31b3d6-0472-49ce-bffb-a9bbeb24281f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:24.309279 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-aa31b3d6-0472-49ce-bffb-a9bbeb24281f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:24.317982 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-aa31b3d6-0472-49ce-bffb-a9bbeb24281f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1573 microversion: 2.1 time: 0.215968 Sep 26 18:19:24.318545 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 583/1149] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:24 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1573 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:25.344760 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-f46de02c-28b6-475d-ae5c-05a4d3234da8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:25.345381 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-f46de02c-28b6-475d-ae5c-05a4d3234da8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:25.351922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f46de02c-28b6-475d-ae5c-05a4d3234da8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:25.352411 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f46de02c-28b6-475d-ae5c-05a4d3234da8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:25.352853 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f46de02c-28b6-475d-ae5c-05a4d3234da8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:25.353547 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f46de02c-28b6-475d-ae5c-05a4d3234da8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:25.354007 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f46de02c-28b6-475d-ae5c-05a4d3234da8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:25.354431 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-f46de02c-28b6-475d-ae5c-05a4d3234da8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:25.549586 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-f46de02c-28b6-475d-ae5c-05a4d3234da8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:25.557236 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-f46de02c-28b6-475d-ae5c-05a4d3234da8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1573 microversion: 2.1 time: 0.217564 Sep 26 18:19:25.557789 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 567/1150] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:25 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1573 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:26.580451 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-985b8762-c6c5-4d06-b141-862c9d350bc9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:26.581010 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-985b8762-c6c5-4d06-b141-862c9d350bc9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:26.587366 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-985b8762-c6c5-4d06-b141-862c9d350bc9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:26.587883 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-985b8762-c6c5-4d06-b141-862c9d350bc9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:26.588325 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-985b8762-c6c5-4d06-b141-862c9d350bc9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:26.589025 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-985b8762-c6c5-4d06-b141-862c9d350bc9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:26.589485 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-985b8762-c6c5-4d06-b141-862c9d350bc9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:26.590019 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-985b8762-c6c5-4d06-b141-862c9d350bc9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:26.812412 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-985b8762-c6c5-4d06-b141-862c9d350bc9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:26.820297 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-985b8762-c6c5-4d06-b141-862c9d350bc9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1573 microversion: 2.1 time: 0.244221 Sep 26 18:19:26.823635 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 584/1151] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:26 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1573 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:27.281957 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-32297dfb-bf42-4044-9262-fc7a06509a6c req-aebc8084-9c79-44ee-826d-27f6849526e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9a3691-e877-45a2-9a0a-5f13beb60456", "name": "network-vif-deleted", "tag": "16bd7397-f015-4e5f-a7dd-26ae2d5b08bc"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:19:27.292323 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-32297dfb-bf42-4044-9262-fc7a06509a6c req-aebc8084-9c79-44ee-826d-27f6849526e3 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:27.292806 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-32297dfb-bf42-4044-9262-fc7a06509a6c req-aebc8084-9c79-44ee-826d-27f6849526e3 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:27.293239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-32297dfb-bf42-4044-9262-fc7a06509a6c req-aebc8084-9c79-44ee-826d-27f6849526e3 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:27.304650 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-32297dfb-bf42-4044-9262-fc7a06509a6c req-aebc8084-9c79-44ee-826d-27f6849526e3 service nova] Creating event network-vif-deleted:16bd7397-f015-4e5f-a7dd-26ae2d5b08bc for instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 on hv-cinder-85931 Sep 26 18:19:27.309800 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-32297dfb-bf42-4044-9262-fc7a06509a6c req-aebc8084-9c79-44ee-826d-27f6849526e3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032415 Sep 26 18:19:27.312729 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 568/1152] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:19:27.844743 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e100c48b-774a-430f-82e0-1980d8b0dd13 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:27.845412 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e100c48b-774a-430f-82e0-1980d8b0dd13 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:27.852411 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e100c48b-774a-430f-82e0-1980d8b0dd13 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:27.852902 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e100c48b-774a-430f-82e0-1980d8b0dd13 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:27.853346 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e100c48b-774a-430f-82e0-1980d8b0dd13 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:27.854105 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e100c48b-774a-430f-82e0-1980d8b0dd13 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:27.854574 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e100c48b-774a-430f-82e0-1980d8b0dd13 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:27.855006 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e100c48b-774a-430f-82e0-1980d8b0dd13 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:27.919559 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e100c48b-774a-430f-82e0-1980d8b0dd13 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:27.928292 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e100c48b-774a-430f-82e0-1980d8b0dd13 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 200 len: 1221 microversion: 2.1 time: 0.089642 Sep 26 18:19:27.937728 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 585/1153] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:27 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:28.952872 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-56a09f66-a8c3-40ed-9ecf-075c6c1f4a1c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:28.953639 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-56a09f66-a8c3-40ed-9ecf-075c6c1f4a1c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:28.959846 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-56a09f66-a8c3-40ed-9ecf-075c6c1f4a1c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:28.960323 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-56a09f66-a8c3-40ed-9ecf-075c6c1f4a1c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:28.960751 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-56a09f66-a8c3-40ed-9ecf-075c6c1f4a1c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:28.961552 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-56a09f66-a8c3-40ed-9ecf-075c6c1f4a1c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:28.962012 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-56a09f66-a8c3-40ed-9ecf-075c6c1f4a1c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:28.962409 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-56a09f66-a8c3-40ed-9ecf-075c6c1f4a1c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:28.987455 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-56a09f66-a8c3-40ed-9ecf-075c6c1f4a1c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] HTTP exception thrown: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-56a09f66-a8c3-40ed-9ecf-075c6c1f4a1c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Request method failure captured: Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 HTTP/1.1 Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMeyJZRqFuvQJtZCWeEfnTLoobGafQrCfCPsO4P3kFNSqgC_oGVkCFjcESaRqsFxJntPCuLvn0CRJys-Z4jXe9lWwUBW-K8AkD3c4hlFl8Gp5FHhlSDqADhXBJvw1R0N0TNS5JDfREF6NFtT1Mmi6CfIEMdwBZ9rsEumZd98Bw69578Y Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 54bca4cc170d4e3fbad17be586081bc0 Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-TestVolumeBootPattern-437483383 Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:19:28.989156 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:19:28.991562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:19:28.991562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-TestVolumeBootPattern-437483383 Sep 26 18:19:28.991562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 54bca4cc170d4e3fbad17be586081bc0 Sep 26 18:19:28.991562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-TestVolumeBootPattern-437483383 Sep 26 18:19:28.991562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-TestVolumeBootPattern-437483383-project Sep 26 18:19:28.991562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:19:28.991562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:19:28.991562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 8d96b8d565f94e68a705691a5ec64e04 Sep 26 18:19:28.991562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-TestVolumeBootPattern-437483383-project Sep 26 18:19:28.991562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:19:28.991562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. Sep 26 18:19:28.991562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '7b9a3691-e877-45a2-9a0a-5f13beb60456'} Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:19:28.992887 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. Sep 26 18:19:28.995570 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:19:28.998187 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-56a09f66-a8c3-40ed-9ecf-075c6c1f4a1c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Returning 404 to user: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:19:28.998187 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-56a09f66-a8c3-40ed-9ecf-075c6c1f4a1c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 404 len: 111 microversion: 2.1 time: 0.043291 Sep 26 18:19:28.998187 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 569/1154] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:28 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:19:29.055607 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1543359875", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-7185126", "security_groups": [{"name": "tempest-secgroup-smoke-544660154"}], "block_device_mapping_v2": [{"uuid": "cc4af79f-305f-430b-bc5c-089f18ffaa71", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ba9a025-fbef-406e-aa56-d82e69f22721"}]}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:19:29.187740 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.network.neutron [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] validate_networks() for [('5ba9a025-fbef-406e-aa56-d82e69f22721', None, None, None, None, None)] {{(pid=121029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:19:29.657463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Flavor limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:19:29.657890 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Image limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:19:29.658367 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Flavor pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:19:29.658775 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Image pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:19:29.659210 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:19:29.668695 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:29.669170 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:29.669601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:29.671388 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:29.671990 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:29.672406 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:29.690181 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Getting quotas for project 54bca4cc170d4e3fbad17be586081bc0. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:19:29.694328 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Getting quotas for user 8d96b8d565f94e68a705691a5ec64e04 and project 54bca4cc170d4e3fbad17be586081bc0. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:19:29.764491 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Going to run 1 instances... {{(pid=121029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:19:29.766755 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc4af79f-305f-430b-bc5c-089f18ffaa71',volume_size=None,volume_type=None)] {{(pid=121029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:19:30.151004 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-0a551392-fa59-4acd-bac6-5eddd60939d6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.099456 Sep 26 18:19:30.151735 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 586/1155] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:19:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:19:30.163847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1cf7ad63-1e94-47b7-af37-a26aa6300105 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:30.164462 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1cf7ad63-1e94-47b7-af37-a26aa6300105 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:30.221220 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1cf7ad63-1e94-47b7-af37-a26aa6300105 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:30.228114 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1cf7ad63-1e94-47b7-af37-a26aa6300105 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1092 microversion: 2.1 time: 0.068111 Sep 26 18:19:30.228687 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 570/1156] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:30 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1092 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:31.251482 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bc004d6b-831c-4678-a30b-329817a79611 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:31.252111 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-bc004d6b-831c-4678-a30b-329817a79611 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:31.258886 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bc004d6b-831c-4678-a30b-329817a79611 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:31.259366 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bc004d6b-831c-4678-a30b-329817a79611 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:31.259827 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bc004d6b-831c-4678-a30b-329817a79611 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:31.260517 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bc004d6b-831c-4678-a30b-329817a79611 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:31.260970 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bc004d6b-831c-4678-a30b-329817a79611 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:31.261391 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bc004d6b-831c-4678-a30b-329817a79611 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:31.328528 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bc004d6b-831c-4678-a30b-329817a79611 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:31.336272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bc004d6b-831c-4678-a30b-329817a79611 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1142 microversion: 2.1 time: 0.089507 Sep 26 18:19:31.336834 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 587/1157] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:31 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1142 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:32.360773 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-23ba719a-b960-4a86-996c-87683fdb21a2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:32.361152 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-23ba719a-b960-4a86-996c-87683fdb21a2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:32.368790 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-23ba719a-b960-4a86-996c-87683fdb21a2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:32.369316 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-23ba719a-b960-4a86-996c-87683fdb21a2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:32.369751 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-23ba719a-b960-4a86-996c-87683fdb21a2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:32.370647 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-23ba719a-b960-4a86-996c-87683fdb21a2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:32.371922 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-23ba719a-b960-4a86-996c-87683fdb21a2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:32.372349 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-23ba719a-b960-4a86-996c-87683fdb21a2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:32.448310 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-23ba719a-b960-4a86-996c-87683fdb21a2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:32.457372 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-23ba719a-b960-4a86-996c-87683fdb21a2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1208 microversion: 2.1 time: 0.101438 Sep 26 18:19:32.458508 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 571/1158] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:32 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1208 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:33.483123 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-ada3572d-0bc4-418e-8f78-00d0d9fcc085 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:33.485502 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-ada3572d-0bc4-418e-8f78-00d0d9fcc085 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:33.491290 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ada3572d-0bc4-418e-8f78-00d0d9fcc085 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:33.492021 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ada3572d-0bc4-418e-8f78-00d0d9fcc085 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:33.492657 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ada3572d-0bc4-418e-8f78-00d0d9fcc085 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:33.493533 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ada3572d-0bc4-418e-8f78-00d0d9fcc085 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:33.494157 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ada3572d-0bc4-418e-8f78-00d0d9fcc085 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:33.494765 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-ada3572d-0bc4-418e-8f78-00d0d9fcc085 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:33.713032 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-ada3572d-0bc4-418e-8f78-00d0d9fcc085 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:33.722188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-ada3572d-0bc4-418e-8f78-00d0d9fcc085 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1275 microversion: 2.1 time: 0.243743 Sep 26 18:19:33.723015 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 588/1159] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:33 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1275 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:34.270213 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-063c8968-de58-4b7b-9220-ea0198bc9b70 req-f9144f20-ae86-41e0-80d4-88735dadbf04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee134731-9f42-49a9-85df-cc94e3c6ca02", "tag": "ab287099-77e4-4781-991d-6e39e2a3928a"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:19:34.281977 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-063c8968-de58-4b7b-9220-ea0198bc9b70 req-f9144f20-ae86-41e0-80d4-88735dadbf04 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:34.282860 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-063c8968-de58-4b7b-9220-ea0198bc9b70 req-f9144f20-ae86-41e0-80d4-88735dadbf04 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:34.283298 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-063c8968-de58-4b7b-9220-ea0198bc9b70 req-f9144f20-ae86-41e0-80d4-88735dadbf04 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:34.299609 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-063c8968-de58-4b7b-9220-ea0198bc9b70 req-f9144f20-ae86-41e0-80d4-88735dadbf04 service nova] Creating event network-changed:ab287099-77e4-4781-991d-6e39e2a3928a for instance ee134731-9f42-49a9-85df-cc94e3c6ca02 on hv-cinder-85931 Sep 26 18:19:34.304670 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-063c8968-de58-4b7b-9220-ea0198bc9b70 req-f9144f20-ae86-41e0-80d4-88735dadbf04 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039539 Sep 26 18:19:34.305311 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 572/1160] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 18:19:34.744554 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f55fb667-76b4-4a8b-8d03-8f762f62667e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:34.745522 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f55fb667-76b4-4a8b-8d03-8f762f62667e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:34.752953 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f55fb667-76b4-4a8b-8d03-8f762f62667e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:34.753446 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f55fb667-76b4-4a8b-8d03-8f762f62667e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:34.753881 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f55fb667-76b4-4a8b-8d03-8f762f62667e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:34.754737 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f55fb667-76b4-4a8b-8d03-8f762f62667e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:34.755204 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f55fb667-76b4-4a8b-8d03-8f762f62667e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:34.755630 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f55fb667-76b4-4a8b-8d03-8f762f62667e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:35.002023 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f55fb667-76b4-4a8b-8d03-8f762f62667e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:35.009630 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f55fb667-76b4-4a8b-8d03-8f762f62667e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1263 microversion: 2.1 time: 0.268947 Sep 26 18:19:35.010198 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 589/1161] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:34 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1263 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:36.036147 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-5bb5658f-03b6-4e65-94d2-d216f699b66e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:36.036955 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-5bb5658f-03b6-4e65-94d2-d216f699b66e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:36.044364 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5bb5658f-03b6-4e65-94d2-d216f699b66e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:36.045180 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5bb5658f-03b6-4e65-94d2-d216f699b66e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:36.045821 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5bb5658f-03b6-4e65-94d2-d216f699b66e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:36.046589 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5bb5658f-03b6-4e65-94d2-d216f699b66e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:36.047109 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5bb5658f-03b6-4e65-94d2-d216f699b66e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:36.047599 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-5bb5658f-03b6-4e65-94d2-d216f699b66e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:36.186172 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-5bb5658f-03b6-4e65-94d2-d216f699b66e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:36.194010 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-5bb5658f-03b6-4e65-94d2-d216f699b66e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1263 microversion: 2.1 time: 0.163084 Sep 26 18:19:36.194602 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 573/1162] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:36 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:37.221987 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-f30fc37f-379d-48d2-b3ed-274968797d7d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:37.222748 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-f30fc37f-379d-48d2-b3ed-274968797d7d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:37.229166 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f30fc37f-379d-48d2-b3ed-274968797d7d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:37.229670 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f30fc37f-379d-48d2-b3ed-274968797d7d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:37.230098 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f30fc37f-379d-48d2-b3ed-274968797d7d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:37.230784 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f30fc37f-379d-48d2-b3ed-274968797d7d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:37.231234 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f30fc37f-379d-48d2-b3ed-274968797d7d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:37.231691 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-f30fc37f-379d-48d2-b3ed-274968797d7d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:37.368094 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-f30fc37f-379d-48d2-b3ed-274968797d7d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:37.376266 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-f30fc37f-379d-48d2-b3ed-274968797d7d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1263 microversion: 2.1 time: 0.159135 Sep 26 18:19:37.376834 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 590/1163] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:37 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:38.399352 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-6ad3e2c9-4ee1-4cd9-b145-121402eaeef7 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:38.400030 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-6ad3e2c9-4ee1-4cd9-b145-121402eaeef7 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:38.406529 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ad3e2c9-4ee1-4cd9-b145-121402eaeef7 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:38.407014 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ad3e2c9-4ee1-4cd9-b145-121402eaeef7 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:38.407451 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ad3e2c9-4ee1-4cd9-b145-121402eaeef7 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:38.408183 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ad3e2c9-4ee1-4cd9-b145-121402eaeef7 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:38.408643 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ad3e2c9-4ee1-4cd9-b145-121402eaeef7 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:38.409068 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-6ad3e2c9-4ee1-4cd9-b145-121402eaeef7 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:38.544292 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-6ad3e2c9-4ee1-4cd9-b145-121402eaeef7 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:38.552813 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-6ad3e2c9-4ee1-4cd9-b145-121402eaeef7 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1263 microversion: 2.1 time: 0.157612 Sep 26 18:19:38.553361 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 574/1164] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:38 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:39.575870 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-750252e7-eba4-4f18-b3ef-be488fc3f2ab tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:39.577275 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-750252e7-eba4-4f18-b3ef-be488fc3f2ab tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:39.583657 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-750252e7-eba4-4f18-b3ef-be488fc3f2ab tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:39.584198 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-750252e7-eba4-4f18-b3ef-be488fc3f2ab tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:39.584633 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-750252e7-eba4-4f18-b3ef-be488fc3f2ab tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:39.585318 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-750252e7-eba4-4f18-b3ef-be488fc3f2ab tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:39.585767 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-750252e7-eba4-4f18-b3ef-be488fc3f2ab tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:39.586188 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-750252e7-eba4-4f18-b3ef-be488fc3f2ab tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:39.680096 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:19:39.700734 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=6 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:19:39.725287 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-750252e7-eba4-4f18-b3ef-be488fc3f2ab tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:39.733838 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-750252e7-eba4-4f18-b3ef-be488fc3f2ab tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1263 microversion: 2.1 time: 0.161863 Sep 26 18:19:39.734416 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 591/1165] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:39 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:40.757841 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-e028ff6d-78c4-434c-967a-373a4b69f429 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:40.758874 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-e028ff6d-78c4-434c-967a-373a4b69f429 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:40.761280 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=2 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:19:40.766833 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e028ff6d-78c4-434c-967a-373a4b69f429 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:40.772152 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e028ff6d-78c4-434c-967a-373a4b69f429 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:40.772152 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e028ff6d-78c4-434c-967a-373a4b69f429 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:40.772152 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e028ff6d-78c4-434c-967a-373a4b69f429 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:40.772152 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e028ff6d-78c4-434c-967a-373a4b69f429 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:40.772567 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-e028ff6d-78c4-434c-967a-373a4b69f429 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:40.902389 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-e028ff6d-78c4-434c-967a-373a4b69f429 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:40.910198 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-e028ff6d-78c4-434c-967a-373a4b69f429 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1263 microversion: 2.1 time: 0.156168 Sep 26 18:19:40.910763 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 575/1166] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:40 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:41.933512 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-984dbb5f-d5a2-42cf-936a-ce58520b7180 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:41.934065 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-984dbb5f-d5a2-42cf-936a-ce58520b7180 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:41.940853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-984dbb5f-d5a2-42cf-936a-ce58520b7180 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:41.941328 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-984dbb5f-d5a2-42cf-936a-ce58520b7180 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:41.941754 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-984dbb5f-d5a2-42cf-936a-ce58520b7180 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:41.942432 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-984dbb5f-d5a2-42cf-936a-ce58520b7180 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:41.942885 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-984dbb5f-d5a2-42cf-936a-ce58520b7180 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:41.943307 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-984dbb5f-d5a2-42cf-936a-ce58520b7180 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:42.079151 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-984dbb5f-d5a2-42cf-936a-ce58520b7180 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:42.086857 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-984dbb5f-d5a2-42cf-936a-ce58520b7180 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1263 microversion: 2.1 time: 0.157786 Sep 26 18:19:42.087426 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 592/1167] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:41 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:43.110297 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-7a914d51-d334-4563-b621-35ec2a01c155 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:43.110947 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-7a914d51-d334-4563-b621-35ec2a01c155 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:43.117580 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a914d51-d334-4563-b621-35ec2a01c155 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:43.118552 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a914d51-d334-4563-b621-35ec2a01c155 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:43.118984 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a914d51-d334-4563-b621-35ec2a01c155 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:43.119689 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a914d51-d334-4563-b621-35ec2a01c155 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:43.120141 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a914d51-d334-4563-b621-35ec2a01c155 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:43.120564 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-7a914d51-d334-4563-b621-35ec2a01c155 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:43.255003 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-7a914d51-d334-4563-b621-35ec2a01c155 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:43.265299 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-7a914d51-d334-4563-b621-35ec2a01c155 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1263 microversion: 2.1 time: 0.158836 Sep 26 18:19:43.266699 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 576/1168] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:43 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:44.289321 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-0e7ecb51-c826-4e6d-b709-d7257b392fdc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:44.289879 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-0e7ecb51-c826-4e6d-b709-d7257b392fdc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:44.297060 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0e7ecb51-c826-4e6d-b709-d7257b392fdc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:44.297540 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0e7ecb51-c826-4e6d-b709-d7257b392fdc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:44.297967 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0e7ecb51-c826-4e6d-b709-d7257b392fdc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:44.298648 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0e7ecb51-c826-4e6d-b709-d7257b392fdc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:44.299100 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0e7ecb51-c826-4e6d-b709-d7257b392fdc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:44.299518 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-0e7ecb51-c826-4e6d-b709-d7257b392fdc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:44.435367 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-0e7ecb51-c826-4e6d-b709-d7257b392fdc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:44.443617 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-0e7ecb51-c826-4e6d-b709-d7257b392fdc tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1263 microversion: 2.1 time: 0.158224 Sep 26 18:19:44.444308 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 593/1169] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:44 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:44.648787 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-b8d5998a-2ec8-4d9b-b57c-f1138f3dfe4a req-9beda926-7c7a-4ab6-acc9-b7678abef812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee134731-9f42-49a9-85df-cc94e3c6ca02", "name": "network-vif-plugged", "status": "completed", "tag": "ab287099-77e4-4781-991d-6e39e2a3928a"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:19:44.658158 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-b8d5998a-2ec8-4d9b-b57c-f1138f3dfe4a req-9beda926-7c7a-4ab6-acc9-b7678abef812 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:44.658637 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-b8d5998a-2ec8-4d9b-b57c-f1138f3dfe4a req-9beda926-7c7a-4ab6-acc9-b7678abef812 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:44.659071 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-b8d5998a-2ec8-4d9b-b57c-f1138f3dfe4a req-9beda926-7c7a-4ab6-acc9-b7678abef812 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:44.670278 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-b8d5998a-2ec8-4d9b-b57c-f1138f3dfe4a req-9beda926-7c7a-4ab6-acc9-b7678abef812 service nova] Creating event network-vif-plugged:ab287099-77e4-4781-991d-6e39e2a3928a for instance ee134731-9f42-49a9-85df-cc94e3c6ca02 on hv-cinder-85931 Sep 26 18:19:44.675299 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-b8d5998a-2ec8-4d9b-b57c-f1138f3dfe4a req-9beda926-7c7a-4ab6-acc9-b7678abef812 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091832 Sep 26 18:19:44.676229 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 577/1170] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:19:45.466635 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-585207e9-12c3-4bdd-89d9-e4ff490a3b16 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:45.467369 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-585207e9-12c3-4bdd-89d9-e4ff490a3b16 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:45.473837 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-585207e9-12c3-4bdd-89d9-e4ff490a3b16 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:45.474327 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-585207e9-12c3-4bdd-89d9-e4ff490a3b16 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:45.474768 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-585207e9-12c3-4bdd-89d9-e4ff490a3b16 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:45.475467 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-585207e9-12c3-4bdd-89d9-e4ff490a3b16 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:45.475956 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-585207e9-12c3-4bdd-89d9-e4ff490a3b16 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:45.476390 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-585207e9-12c3-4bdd-89d9-e4ff490a3b16 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:45.607096 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-585207e9-12c3-4bdd-89d9-e4ff490a3b16 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:45.614988 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-585207e9-12c3-4bdd-89d9-e4ff490a3b16 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1263 microversion: 2.1 time: 0.152215 Sep 26 18:19:45.615544 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 594/1171] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:45 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:46.639122 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-374c5009-f29b-4ea0-a4a2-fb145cf9751d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:46.639852 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-374c5009-f29b-4ea0-a4a2-fb145cf9751d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:46.646585 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-374c5009-f29b-4ea0-a4a2-fb145cf9751d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:46.647079 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-374c5009-f29b-4ea0-a4a2-fb145cf9751d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:46.647516 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-374c5009-f29b-4ea0-a4a2-fb145cf9751d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:46.648484 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-374c5009-f29b-4ea0-a4a2-fb145cf9751d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:46.648944 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-374c5009-f29b-4ea0-a4a2-fb145cf9751d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:46.650374 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-374c5009-f29b-4ea0-a4a2-fb145cf9751d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:46.787144 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-374c5009-f29b-4ea0-a4a2-fb145cf9751d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:46.795063 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-374c5009-f29b-4ea0-a4a2-fb145cf9751d tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1450 microversion: 2.1 time: 0.160711 Sep 26 18:19:46.795620 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 578/1172] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:46 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:46.817711 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b03278cc-8976-430c-bc25-a66035e5b1b8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:19:46.818556 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b03278cc-8976-430c-bc25-a66035e5b1b8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:19:46.824769 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b03278cc-8976-430c-bc25-a66035e5b1b8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:46.825249 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b03278cc-8976-430c-bc25-a66035e5b1b8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:46.825710 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b03278cc-8976-430c-bc25-a66035e5b1b8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:46.826386 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b03278cc-8976-430c-bc25-a66035e5b1b8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:46.826869 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b03278cc-8976-430c-bc25-a66035e5b1b8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:46.827289 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b03278cc-8976-430c-bc25-a66035e5b1b8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:46.959960 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b03278cc-8976-430c-bc25-a66035e5b1b8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:19:46.967732 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b03278cc-8976-430c-bc25-a66035e5b1b8 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1450 microversion: 2.1 time: 0.154888 Sep 26 18:19:46.968356 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 595/1173] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:19:46 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:19:48.929118 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-7f612fd5-f5ba-4060-bf2a-371ceb4cc339 req-557f1f44-c9e0-40a1-aaf6-f8491302c8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee134731-9f42-49a9-85df-cc94e3c6ca02", "tag": "ab287099-77e4-4781-991d-6e39e2a3928a"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:19:48.939231 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-7f612fd5-f5ba-4060-bf2a-371ceb4cc339 req-557f1f44-c9e0-40a1-aaf6-f8491302c8f3 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:19:48.939728 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-7f612fd5-f5ba-4060-bf2a-371ceb4cc339 req-557f1f44-c9e0-40a1-aaf6-f8491302c8f3 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:19:48.940160 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-7f612fd5-f5ba-4060-bf2a-371ceb4cc339 req-557f1f44-c9e0-40a1-aaf6-f8491302c8f3 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:19:48.951006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-7f612fd5-f5ba-4060-bf2a-371ceb4cc339 req-557f1f44-c9e0-40a1-aaf6-f8491302c8f3 service nova] Creating event network-changed:ab287099-77e4-4781-991d-6e39e2a3928a for instance ee134731-9f42-49a9-85df-cc94e3c6ca02 on hv-cinder-85931 Sep 26 18:19:48.957764 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-7f612fd5-f5ba-4060-bf2a-371ceb4cc339 req-557f1f44-c9e0-40a1-aaf6-f8491302c8f3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031973 Sep 26 18:19:48.958640 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 579/1174] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:21:26.672621 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR oslo.messaging._drivers.impl_rabbit [-] [25b7b666-1e45-484d-9f32-831145ce59be] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 26 18:21:26.673195 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:21:26.674052 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=74 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:21:26.674846 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 18:21:26.674981 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Mon Sep 26 18:21:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.67) !!! Sep 26 18:21:26.675965 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 18:21:26.676107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Mon Sep 26 18:21:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.67) !!! Sep 26 18:21:26.680589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-875758756", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-7185126", "security_groups": [{"name": "tempest-secgroup-smoke-544660154"}], "block_device_mapping_v2": [{"uuid": "7052f5c1-671d-4eb2-a53c-ee41f950112d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ba9a025-fbef-406e-aa56-d82e69f22721"}]}} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:21:26.803397 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.network.neutron [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] validate_networks() for [('5ba9a025-fbef-406e-aa56-d82e69f22721', None, None, None, None, None)] {{(pid=121029) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 18:21:27.182908 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Flavor limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 18:21:27.183354 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Image limits 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 18:21:27.183874 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Flavor pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 18:21:27.184294 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Image pref 0:0:0 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 18:21:27.184713 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.virt.hardware [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 18:21:27.193927 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:27.194415 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:27.194855 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:27.195589 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:27.202283 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:27.202283 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:27.213919 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Getting quotas for project 54bca4cc170d4e3fbad17be586081bc0. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 18:21:27.217688 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.quota [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Getting quotas for user 8d96b8d565f94e68a705691a5ec64e04 and project 54bca4cc170d4e3fbad17be586081bc0. Resources: {'ram', 'cores', 'instances'} {{(pid=121029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 18:21:27.277816 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Going to run 1 instances... {{(pid=121029) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 18:21:27.279919 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7052f5c1-671d-4eb2-a53c-ee41f950112d',volume_size=None,volume_type=None)] {{(pid=121029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 18:21:27.680731 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO oslo.messaging._drivers.impl_rabbit [-] [25b7b666-1e45-484d-9f32-831145ce59be] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 51800. Sep 26 18:21:27.702541 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-cb6a6622-56e7-4c9f-818e-028826f42c81 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.031888 Sep 26 18:21:27.703195 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 596/1175] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Sep 26 18:21:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 18:21:27.720142 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:21:27.720906 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:21:27.721712 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 18:21:27.721859 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Mon Sep 26 18:21:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db (ip 10.222.0.67) !!! Sep 26 18:21:27.728084 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-2dfc9120-0549-4724-921e-007b1a458c4b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:27.728683 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-2dfc9120-0549-4724-921e-007b1a458c4b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:27.784766 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-2dfc9120-0549-4724-921e-007b1a458c4b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:27.793419 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-2dfc9120-0549-4724-921e-007b1a458c4b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1091 microversion: 2.1 time: 0.082303 Sep 26 18:21:27.794047 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 580/1176] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:27 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1091 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:21:28.818046 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-72d5ce8f-2843-4044-a8d9-e33198575067 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:28.818886 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-72d5ce8f-2843-4044-a8d9-e33198575067 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:28.826112 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-72d5ce8f-2843-4044-a8d9-e33198575067 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:28.826601 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-72d5ce8f-2843-4044-a8d9-e33198575067 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:28.827042 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-72d5ce8f-2843-4044-a8d9-e33198575067 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:28.827770 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-72d5ce8f-2843-4044-a8d9-e33198575067 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:28.828232 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-72d5ce8f-2843-4044-a8d9-e33198575067 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:28.828852 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-72d5ce8f-2843-4044-a8d9-e33198575067 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:28.890676 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-72d5ce8f-2843-4044-a8d9-e33198575067 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:28.899577 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-72d5ce8f-2843-4044-a8d9-e33198575067 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1133 microversion: 2.1 time: 0.086614 Sep 26 18:21:28.900356 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 597/1177] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:28 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1133 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:21:29.924325 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4bf6ac9e-6cce-4584-bf66-f9a133ff452a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:29.924936 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4bf6ac9e-6cce-4584-bf66-f9a133ff452a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:29.931863 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4bf6ac9e-6cce-4584-bf66-f9a133ff452a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:29.932350 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4bf6ac9e-6cce-4584-bf66-f9a133ff452a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:29.932778 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4bf6ac9e-6cce-4584-bf66-f9a133ff452a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:29.933467 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4bf6ac9e-6cce-4584-bf66-f9a133ff452a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:29.933918 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4bf6ac9e-6cce-4584-bf66-f9a133ff452a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:29.934340 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4bf6ac9e-6cce-4584-bf66-f9a133ff452a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:30.042489 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-4bf6ac9e-6cce-4584-bf66-f9a133ff452a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:30.050225 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4bf6ac9e-6cce-4584-bf66-f9a133ff452a tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1207 microversion: 2.1 time: 0.131716 Sep 26 18:21:30.050786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 581/1178] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:29 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1207 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:21:31.073160 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-bbe4091a-b0db-4ec7-8fc6-8405f2649ba9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:31.073855 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-bbe4091a-b0db-4ec7-8fc6-8405f2649ba9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:31.080351 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbe4091a-b0db-4ec7-8fc6-8405f2649ba9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:31.080848 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbe4091a-b0db-4ec7-8fc6-8405f2649ba9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:31.081287 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbe4091a-b0db-4ec7-8fc6-8405f2649ba9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:31.081996 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbe4091a-b0db-4ec7-8fc6-8405f2649ba9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:31.082457 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbe4091a-b0db-4ec7-8fc6-8405f2649ba9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:31.082885 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-bbe4091a-b0db-4ec7-8fc6-8405f2649ba9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:31.341741 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-bbe4091a-b0db-4ec7-8fc6-8405f2649ba9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:31.350999 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-bbe4091a-b0db-4ec7-8fc6-8405f2649ba9 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1274 microversion: 2.1 time: 0.281640 Sep 26 18:21:31.351901 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 598/1179] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:31 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1274 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:21:32.374153 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-97f16f99-4939-4f33-be9a-fe8cf0ffde30 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:32.374780 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-97f16f99-4939-4f33-be9a-fe8cf0ffde30 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:32.382630 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-97f16f99-4939-4f33-be9a-fe8cf0ffde30 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:32.383425 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-97f16f99-4939-4f33-be9a-fe8cf0ffde30 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:32.384272 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-97f16f99-4939-4f33-be9a-fe8cf0ffde30 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:32.384983 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-97f16f99-4939-4f33-be9a-fe8cf0ffde30 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:32.385722 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-97f16f99-4939-4f33-be9a-fe8cf0ffde30 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:32.386477 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-97f16f99-4939-4f33-be9a-fe8cf0ffde30 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:32.390694 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-4d6eb6c0-fadb-4cd8-9ffe-1fce93bf8ea7 req-39712af6-30cc-4c9e-b9d0-baa85180ffbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7989dee4-521d-4275-876b-69d36e5ee0db", "tag": "b2b35103-46c3-4558-861f-f606c2d21726"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:21:32.404892 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-4d6eb6c0-fadb-4cd8-9ffe-1fce93bf8ea7 req-39712af6-30cc-4c9e-b9d0-baa85180ffbe service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:32.406101 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-4d6eb6c0-fadb-4cd8-9ffe-1fce93bf8ea7 req-39712af6-30cc-4c9e-b9d0-baa85180ffbe service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:32.406433 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-4d6eb6c0-fadb-4cd8-9ffe-1fce93bf8ea7 req-39712af6-30cc-4c9e-b9d0-baa85180ffbe service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:32.419458 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-4d6eb6c0-fadb-4cd8-9ffe-1fce93bf8ea7 req-39712af6-30cc-4c9e-b9d0-baa85180ffbe service nova] Creating event network-changed:b2b35103-46c3-4558-861f-f606c2d21726 for instance 7989dee4-521d-4275-876b-69d36e5ee0db on hv-cinder-85931 Sep 26 18:21:32.425026 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-4d6eb6c0-fadb-4cd8-9ffe-1fce93bf8ea7 req-39712af6-30cc-4c9e-b9d0-baa85180ffbe service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178225 Sep 26 18:21:32.425622 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 582/1180] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:21:32.665107 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-97f16f99-4939-4f33-be9a-fe8cf0ffde30 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:32.673247 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-97f16f99-4939-4f33-be9a-fe8cf0ffde30 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1262 microversion: 2.1 time: 0.303095 Sep 26 18:21:32.673827 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 599/1181] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:32 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1262 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:21:33.699006 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-b81ac727-beb2-4fe9-ace6-2bdbe1e9d20e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:33.699670 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-b81ac727-beb2-4fe9-ace6-2bdbe1e9d20e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:33.705858 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b81ac727-beb2-4fe9-ace6-2bdbe1e9d20e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:33.706349 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b81ac727-beb2-4fe9-ace6-2bdbe1e9d20e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:33.706789 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b81ac727-beb2-4fe9-ace6-2bdbe1e9d20e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:33.707492 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b81ac727-beb2-4fe9-ace6-2bdbe1e9d20e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:33.708484 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b81ac727-beb2-4fe9-ace6-2bdbe1e9d20e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:33.708914 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-b81ac727-beb2-4fe9-ace6-2bdbe1e9d20e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:33.876661 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-b81ac727-beb2-4fe9-ace6-2bdbe1e9d20e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:33.885933 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-b81ac727-beb2-4fe9-ace6-2bdbe1e9d20e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1262 microversion: 2.1 time: 0.191670 Sep 26 18:21:33.886499 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 583/1182] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:33 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1262 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:21:34.909963 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-9a7e902d-e335-4206-bfea-3fd115661f92 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:34.910578 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-9a7e902d-e335-4206-bfea-3fd115661f92 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:34.917565 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9a7e902d-e335-4206-bfea-3fd115661f92 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:34.918054 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9a7e902d-e335-4206-bfea-3fd115661f92 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:34.918509 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9a7e902d-e335-4206-bfea-3fd115661f92 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:34.919181 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9a7e902d-e335-4206-bfea-3fd115661f92 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:34.919638 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9a7e902d-e335-4206-bfea-3fd115661f92 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:34.920093 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-9a7e902d-e335-4206-bfea-3fd115661f92 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:35.049710 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-9a7e902d-e335-4206-bfea-3fd115661f92 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:35.057763 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-9a7e902d-e335-4206-bfea-3fd115661f92 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1262 microversion: 2.1 time: 0.151732 Sep 26 18:21:35.058324 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 600/1183] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:34 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1262 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:21:36.081097 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-1389ef6a-e97a-4583-8516-838f2e36fad6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:36.087173 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-1389ef6a-e97a-4583-8516-838f2e36fad6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:36.089110 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1389ef6a-e97a-4583-8516-838f2e36fad6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:36.089619 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1389ef6a-e97a-4583-8516-838f2e36fad6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:36.090061 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1389ef6a-e97a-4583-8516-838f2e36fad6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:36.090751 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1389ef6a-e97a-4583-8516-838f2e36fad6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:36.091204 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1389ef6a-e97a-4583-8516-838f2e36fad6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:36.091622 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-1389ef6a-e97a-4583-8516-838f2e36fad6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:36.230616 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-1389ef6a-e97a-4583-8516-838f2e36fad6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:36.238406 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-1389ef6a-e97a-4583-8516-838f2e36fad6 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1262 microversion: 2.1 time: 0.161234 Sep 26 18:21:36.239873 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 584/1184] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:36 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1262 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:21:37.262954 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-b8fabe3b-759b-452c-ac05-46a2b2cfd1c4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:37.263541 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-b8fabe3b-759b-452c-ac05-46a2b2cfd1c4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:37.265853 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=2 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:21:37.266549 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell0:SELECT=6 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:21:37.271232 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b8fabe3b-759b-452c-ac05-46a2b2cfd1c4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:37.271739 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b8fabe3b-759b-452c-ac05-46a2b2cfd1c4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:37.272319 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b8fabe3b-759b-452c-ac05-46a2b2cfd1c4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:37.273828 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b8fabe3b-759b-452c-ac05-46a2b2cfd1c4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:37.274025 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b8fabe3b-759b-452c-ac05-46a2b2cfd1c4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:37.274467 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-b8fabe3b-759b-452c-ac05-46a2b2cfd1c4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:37.409644 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-b8fabe3b-759b-452c-ac05-46a2b2cfd1c4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:37.418117 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-b8fabe3b-759b-452c-ac05-46a2b2cfd1c4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1262 microversion: 2.1 time: 0.159066 Sep 26 18:21:37.418698 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 601/1185] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:37 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1262 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:21:38.443083 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-89be7a0a-7b51-4603-ae57-20a811751a62 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:38.444588 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-89be7a0a-7b51-4603-ae57-20a811751a62 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:38.447097 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell0:SELECT=2 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:21:38.451989 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-89be7a0a-7b51-4603-ae57-20a811751a62 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:38.452474 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-89be7a0a-7b51-4603-ae57-20a811751a62 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:38.452910 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-89be7a0a-7b51-4603-ae57-20a811751a62 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:38.453593 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-89be7a0a-7b51-4603-ae57-20a811751a62 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:38.454051 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-89be7a0a-7b51-4603-ae57-20a811751a62 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:38.454474 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-89be7a0a-7b51-4603-ae57-20a811751a62 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:38.589842 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-89be7a0a-7b51-4603-ae57-20a811751a62 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:38.597537 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-89be7a0a-7b51-4603-ae57-20a811751a62 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1262 microversion: 2.1 time: 0.158363 Sep 26 18:21:38.598099 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 585/1186] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:38 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1262 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:21:39.620401 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-182189b7-03bf-4aab-b3f9-5915edc51794 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:39.621044 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-182189b7-03bf-4aab-b3f9-5915edc51794 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:39.628744 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-182189b7-03bf-4aab-b3f9-5915edc51794 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:39.629225 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-182189b7-03bf-4aab-b3f9-5915edc51794 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:39.629651 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-182189b7-03bf-4aab-b3f9-5915edc51794 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:39.630329 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-182189b7-03bf-4aab-b3f9-5915edc51794 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:39.630776 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-182189b7-03bf-4aab-b3f9-5915edc51794 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:39.631220 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-182189b7-03bf-4aab-b3f9-5915edc51794 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:39.763030 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-182189b7-03bf-4aab-b3f9-5915edc51794 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:39.770641 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-182189b7-03bf-4aab-b3f9-5915edc51794 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1262 microversion: 2.1 time: 0.154139 Sep 26 18:21:39.771201 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 602/1187] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:39 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:21:40.794633 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-a74d4a59-08ab-4726-88ac-2b48f004c2d1 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:40.795237 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-a74d4a59-08ab-4726-88ac-2b48f004c2d1 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:40.801650 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a74d4a59-08ab-4726-88ac-2b48f004c2d1 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:40.802126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a74d4a59-08ab-4726-88ac-2b48f004c2d1 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:40.804105 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a74d4a59-08ab-4726-88ac-2b48f004c2d1 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:40.804105 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a74d4a59-08ab-4726-88ac-2b48f004c2d1 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:40.804642 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a74d4a59-08ab-4726-88ac-2b48f004c2d1 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:40.805063 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-a74d4a59-08ab-4726-88ac-2b48f004c2d1 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:40.935903 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-a74d4a59-08ab-4726-88ac-2b48f004c2d1 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:40.943527 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-a74d4a59-08ab-4726-88ac-2b48f004c2d1 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1262 microversion: 2.1 time: 0.152752 Sep 26 18:21:40.944165 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 586/1188] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:40 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1262 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:21:41.966609 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-e6cb2b1b-cfa5-49a9-98d3-37e802f9dd2f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:41.967212 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-e6cb2b1b-cfa5-49a9-98d3-37e802f9dd2f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:41.973658 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e6cb2b1b-cfa5-49a9-98d3-37e802f9dd2f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:41.974147 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e6cb2b1b-cfa5-49a9-98d3-37e802f9dd2f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:41.974584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e6cb2b1b-cfa5-49a9-98d3-37e802f9dd2f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:41.975284 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e6cb2b1b-cfa5-49a9-98d3-37e802f9dd2f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:41.975799 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e6cb2b1b-cfa5-49a9-98d3-37e802f9dd2f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:41.976330 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-e6cb2b1b-cfa5-49a9-98d3-37e802f9dd2f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:42.111194 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-e6cb2b1b-cfa5-49a9-98d3-37e802f9dd2f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:42.120313 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-e6cb2b1b-cfa5-49a9-98d3-37e802f9dd2f tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1262 microversion: 2.1 time: 0.157550 Sep 26 18:21:42.120899 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 603/1189] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:41 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1262 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:21:43.143935 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-d9f3e77b-cb96-4774-9457-a73fc00375d2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:43.144543 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-d9f3e77b-cb96-4774-9457-a73fc00375d2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:43.151226 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-3c0f9c78-ff7b-4764-b70c-72a9aa126cf6 req-1631bea6-1cd8-4571-bc2f-68bc764ec3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7989dee4-521d-4275-876b-69d36e5ee0db", "name": "network-vif-plugged", "status": "completed", "tag": "b2b35103-46c3-4558-861f-f606c2d21726"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:21:43.152438 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9f3e77b-cb96-4774-9457-a73fc00375d2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:43.153562 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9f3e77b-cb96-4774-9457-a73fc00375d2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:43.153703 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9f3e77b-cb96-4774-9457-a73fc00375d2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:43.154343 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9f3e77b-cb96-4774-9457-a73fc00375d2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:43.154752 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9f3e77b-cb96-4774-9457-a73fc00375d2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:43.155326 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-d9f3e77b-cb96-4774-9457-a73fc00375d2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:43.164509 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-3c0f9c78-ff7b-4764-b70c-72a9aa126cf6 req-1631bea6-1cd8-4571-bc2f-68bc764ec3f8 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:43.165132 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-3c0f9c78-ff7b-4764-b70c-72a9aa126cf6 req-1631bea6-1cd8-4571-bc2f-68bc764ec3f8 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:43.165579 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-3c0f9c78-ff7b-4764-b70c-72a9aa126cf6 req-1631bea6-1cd8-4571-bc2f-68bc764ec3f8 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:43.177232 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-3c0f9c78-ff7b-4764-b70c-72a9aa126cf6 req-1631bea6-1cd8-4571-bc2f-68bc764ec3f8 service nova] Creating event network-vif-plugged:b2b35103-46c3-4558-861f-f606c2d21726 for instance 7989dee4-521d-4275-876b-69d36e5ee0db on hv-cinder-85931 Sep 26 18:21:43.185687 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-3c0f9c78-ff7b-4764-b70c-72a9aa126cf6 req-1631bea6-1cd8-4571-bc2f-68bc764ec3f8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038796 Sep 26 18:21:43.187181 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 604/1190] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:21:43.307250 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-d9f3e77b-cb96-4774-9457-a73fc00375d2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:43.315237 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-d9f3e77b-cb96-4774-9457-a73fc00375d2 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1262 microversion: 2.1 time: 0.175667 Sep 26 18:21:43.315954 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 587/1191] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:43 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1262 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:21:44.338776 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-a1c010ec-68c0-4864-a040-41b6d910c086 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:44.339473 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-a1c010ec-68c0-4864-a040-41b6d910c086 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:44.345701 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1c010ec-68c0-4864-a040-41b6d910c086 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:44.346186 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1c010ec-68c0-4864-a040-41b6d910c086 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:44.346649 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1c010ec-68c0-4864-a040-41b6d910c086 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:44.347344 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1c010ec-68c0-4864-a040-41b6d910c086 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:44.347840 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1c010ec-68c0-4864-a040-41b6d910c086 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:44.348278 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-a1c010ec-68c0-4864-a040-41b6d910c086 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:44.480088 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-a1c010ec-68c0-4864-a040-41b6d910c086 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:44.487789 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-a1c010ec-68c0-4864-a040-41b6d910c086 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1262 microversion: 2.1 time: 0.153778 Sep 26 18:21:44.488354 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 605/1192] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:44 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:21:45.511080 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-49aa8343-fdc0-4a9e-8a29-3bb3fa997624 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:45.511789 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-49aa8343-fdc0-4a9e-8a29-3bb3fa997624 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:45.518131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49aa8343-fdc0-4a9e-8a29-3bb3fa997624 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:45.518614 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49aa8343-fdc0-4a9e-8a29-3bb3fa997624 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:45.519046 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49aa8343-fdc0-4a9e-8a29-3bb3fa997624 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:45.519761 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49aa8343-fdc0-4a9e-8a29-3bb3fa997624 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:45.520195 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49aa8343-fdc0-4a9e-8a29-3bb3fa997624 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:45.520610 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-49aa8343-fdc0-4a9e-8a29-3bb3fa997624 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:45.650460 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-49aa8343-fdc0-4a9e-8a29-3bb3fa997624 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:45.658223 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-49aa8343-fdc0-4a9e-8a29-3bb3fa997624 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1449 microversion: 2.1 time: 0.151069 Sep 26 18:21:45.658786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 588/1193] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:45 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:21:45.680766 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d11ad747-c11f-4b62-abc2-51af9df252b3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:21:45.682184 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d11ad747-c11f-4b62-abc2-51af9df252b3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:21:45.688584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d11ad747-c11f-4b62-abc2-51af9df252b3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:45.689069 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d11ad747-c11f-4b62-abc2-51af9df252b3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:45.689504 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d11ad747-c11f-4b62-abc2-51af9df252b3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:45.690192 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d11ad747-c11f-4b62-abc2-51af9df252b3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:45.690649 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d11ad747-c11f-4b62-abc2-51af9df252b3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:45.691075 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d11ad747-c11f-4b62-abc2-51af9df252b3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:45.825225 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-d11ad747-c11f-4b62-abc2-51af9df252b3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:21:45.833044 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d11ad747-c11f-4b62-abc2-51af9df252b3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1449 microversion: 2.1 time: 0.156187 Sep 26 18:21:45.833618 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 606/1194] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:21:45 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:21:48.080979 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-47547dad-07e8-4b20-a37c-84673c8a35d2 req-b56f59c2-9cc2-44d2-bc5c-3193a8ebd5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7989dee4-521d-4275-876b-69d36e5ee0db", "tag": "b2b35103-46c3-4558-861f-f606c2d21726"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:21:48.090648 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-47547dad-07e8-4b20-a37c-84673c8a35d2 req-b56f59c2-9cc2-44d2-bc5c-3193a8ebd5d0 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:21:48.091197 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-47547dad-07e8-4b20-a37c-84673c8a35d2 req-b56f59c2-9cc2-44d2-bc5c-3193a8ebd5d0 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:21:48.091626 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-47547dad-07e8-4b20-a37c-84673c8a35d2 req-b56f59c2-9cc2-44d2-bc5c-3193a8ebd5d0 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:21:48.102460 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-47547dad-07e8-4b20-a37c-84673c8a35d2 req-b56f59c2-9cc2-44d2-bc5c-3193a8ebd5d0 service nova] Creating event network-changed:b2b35103-46c3-4558-861f-f606c2d21726 for instance 7989dee4-521d-4275-876b-69d36e5ee0db on hv-cinder-85931 Sep 26 18:21:48.108309 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-47547dad-07e8-4b20-a37c-84673c8a35d2 req-b56f59c2-9cc2-44d2-bc5c-3193a8ebd5d0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130606 Sep 26 18:21:48.109001 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 589/1195] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:23:16.556963 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:23:16.557906 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG dbcounter [-] [121029] Writing DB stats nova_cell1:SELECT=58 {{(pid=121029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:23:16.560127 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_api:SELECT=22 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:23:16.560851 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG dbcounter [-] [121028] Writing DB stats nova_cell1:SELECT=46 {{(pid=121028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:23:16.561851 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 18:23:16.561993 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Mon Sep 26 18:23:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.67) !!! Sep 26 18:23:16.563612 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-5cc423bb-28db-4917-9913-a91772d365f3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:23:16.564301 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-5cc423bb-28db-4917-9913-a91772d365f3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:23:16.567591 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-cb7c74fe-ecc8-4727-86e2-487c34563678 req-fbbacd39-00b8-45ae-83e7-fdf3b82f4958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7989dee4-521d-4275-876b-69d36e5ee0db", "tag": "b2b35103-46c3-4558-861f-f606c2d21726"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:23:16.570973 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cc423bb-28db-4917-9913-a91772d365f3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:16.570973 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cc423bb-28db-4917-9913-a91772d365f3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:16.571363 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cc423bb-28db-4917-9913-a91772d365f3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:16.571918 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cc423bb-28db-4917-9913-a91772d365f3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:16.572377 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cc423bb-28db-4917-9913-a91772d365f3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:16.573055 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-5cc423bb-28db-4917-9913-a91772d365f3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:16.581772 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-cb7c74fe-ecc8-4727-86e2-487c34563678 req-fbbacd39-00b8-45ae-83e7-fdf3b82f4958 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:16.582252 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-cb7c74fe-ecc8-4727-86e2-487c34563678 req-fbbacd39-00b8-45ae-83e7-fdf3b82f4958 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:16.582681 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-cb7c74fe-ecc8-4727-86e2-487c34563678 req-fbbacd39-00b8-45ae-83e7-fdf3b82f4958 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:16.594194 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-cb7c74fe-ecc8-4727-86e2-487c34563678 req-fbbacd39-00b8-45ae-83e7-fdf3b82f4958 service nova] Creating event network-changed:b2b35103-46c3-4558-861f-f606c2d21726 for instance 7989dee4-521d-4275-876b-69d36e5ee0db on hv-cinder-85931 Sep 26 18:23:16.599657 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-cb7c74fe-ecc8-4727-86e2-487c34563678 req-fbbacd39-00b8-45ae-83e7-fdf3b82f4958 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041481 Sep 26 18:23:16.600633 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 590/1196] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:23:16.604312 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-5cc423bb-28db-4917-9913-a91772d365f3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Going to try to terminate instance {{(pid=121029) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:23:16.969197 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-5cc423bb-28db-4917-9913-a91772d365f3 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 204 len: 0 microversion: 2.1 time: 0.413089 Sep 26 18:23:16.975613 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 607/1197] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:23:16 2022] DELETE /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 18:23:16.980875 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-09f129af-3d2f-4b2b-92b0-cde4c8c0920b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:23:16.981807 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-09f129af-3d2f-4b2b-92b0-cde4c8c0920b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:23:16.994108 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-09f129af-3d2f-4b2b-92b0-cde4c8c0920b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:16.998599 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-09f129af-3d2f-4b2b-92b0-cde4c8c0920b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:16.998599 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-09f129af-3d2f-4b2b-92b0-cde4c8c0920b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:16.998599 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-09f129af-3d2f-4b2b-92b0-cde4c8c0920b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:16.998599 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-09f129af-3d2f-4b2b-92b0-cde4c8c0920b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:16.998989 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-09f129af-3d2f-4b2b-92b0-cde4c8c0920b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:17.148777 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-09f129af-3d2f-4b2b-92b0-cde4c8c0920b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:23:17.158137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-09f129af-3d2f-4b2b-92b0-cde4c8c0920b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1573 microversion: 2.1 time: 0.183025 Sep 26 18:23:17.158723 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 591/1198] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:23:16 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1573 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 18:23:18.182637 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-4c715280-ec1a-4f85-b77b-57c4f53b8528 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:23:18.183328 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-4c715280-ec1a-4f85-b77b-57c4f53b8528 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:23:18.190604 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4c715280-ec1a-4f85-b77b-57c4f53b8528 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:18.203190 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4c715280-ec1a-4f85-b77b-57c4f53b8528 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:18.203190 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4c715280-ec1a-4f85-b77b-57c4f53b8528 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:18.203190 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4c715280-ec1a-4f85-b77b-57c4f53b8528 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:18.203190 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4c715280-ec1a-4f85-b77b-57c4f53b8528 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:18.203639 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-4c715280-ec1a-4f85-b77b-57c4f53b8528 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:18.328799 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-4c715280-ec1a-4f85-b77b-57c4f53b8528 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:23:18.336507 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-4c715280-ec1a-4f85-b77b-57c4f53b8528 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1573 microversion: 2.1 time: 0.158204 Sep 26 18:23:18.337104 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 608/1199] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:23:18 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:23:19.303465 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [req-fd532622-ee32-4710-bd6d-105bcf821c71 req-bafaba05-d37d-44bd-b295-f19b2db0002a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7989dee4-521d-4275-876b-69d36e5ee0db", "name": "network-vif-deleted", "tag": "b2b35103-46c3-4558-861f-f606c2d21726"}]} {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:23:19.313603 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-fd532622-ee32-4710-bd6d-105bcf821c71 req-bafaba05-d37d-44bd-b295-f19b2db0002a service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:19.314131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-fd532622-ee32-4710-bd6d-105bcf821c71 req-bafaba05-d37d-44bd-b295-f19b2db0002a service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:19.314579 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [req-fd532622-ee32-4710-bd6d-105bcf821c71 req-bafaba05-d37d-44bd-b295-f19b2db0002a service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:19.325522 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.compute.server_external_events [req-fd532622-ee32-4710-bd6d-105bcf821c71 req-bafaba05-d37d-44bd-b295-f19b2db0002a service nova] Creating event network-vif-deleted:b2b35103-46c3-4558-861f-f606c2d21726 for instance 7989dee4-521d-4275-876b-69d36e5ee0db on hv-cinder-85931 Sep 26 18:23:19.330635 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [req-fd532622-ee32-4710-bd6d-105bcf821c71 req-bafaba05-d37d-44bd-b295-f19b2db0002a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030880 Sep 26 18:23:19.331210 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 592/1200] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:23:19.359905 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-63cd0826-439b-469b-8a20-d31cf09a57b5 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:23:19.360618 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-63cd0826-439b-469b-8a20-d31cf09a57b5 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:23:19.367010 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-63cd0826-439b-469b-8a20-d31cf09a57b5 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:19.367496 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-63cd0826-439b-469b-8a20-d31cf09a57b5 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:19.368034 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-63cd0826-439b-469b-8a20-d31cf09a57b5 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:19.368730 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-63cd0826-439b-469b-8a20-d31cf09a57b5 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:19.369405 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-63cd0826-439b-469b-8a20-d31cf09a57b5 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:19.369812 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-63cd0826-439b-469b-8a20-d31cf09a57b5 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:19.437048 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-63cd0826-439b-469b-8a20-d31cf09a57b5 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:23:19.445495 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-63cd0826-439b-469b-8a20-d31cf09a57b5 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1388 microversion: 2.1 time: 0.090190 Sep 26 18:23:19.446062 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 609/1201] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:23:19 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:23:20.470176 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4d2fa78b-ef8c-481c-a4f7-145c5e79a9fe tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:23:20.470883 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4d2fa78b-ef8c-481c-a4f7-145c5e79a9fe tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:23:20.477125 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4d2fa78b-ef8c-481c-a4f7-145c5e79a9fe tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:20.477681 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4d2fa78b-ef8c-481c-a4f7-145c5e79a9fe tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:20.478077 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4d2fa78b-ef8c-481c-a4f7-145c5e79a9fe tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:20.478758 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4d2fa78b-ef8c-481c-a4f7-145c5e79a9fe tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:20.479206 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4d2fa78b-ef8c-481c-a4f7-145c5e79a9fe tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:20.479620 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4d2fa78b-ef8c-481c-a4f7-145c5e79a9fe tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:20.512779 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4d2fa78b-ef8c-481c-a4f7-145c5e79a9fe tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:20.513323 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4d2fa78b-ef8c-481c-a4f7-145c5e79a9fe tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:20.513753 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4d2fa78b-ef8c-481c-a4f7-145c5e79a9fe tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:20.514188 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.objects.instance [None req-4d2fa78b-ef8c-481c-a4f7-145c5e79a9fe tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lazy-loading 'fault' on Instance uuid 7989dee4-521d-4275-876b-69d36e5ee0db {{(pid=121028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:23:20.556581 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-4d2fa78b-ef8c-481c-a4f7-145c5e79a9fe tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:23:20.566276 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4d2fa78b-ef8c-481c-a4f7-145c5e79a9fe tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 200 len: 1227 microversion: 2.1 time: 0.101357 Sep 26 18:23:20.566849 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 593/1202] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:23:20 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 1227 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:23:21.590290 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-caa1f45a-0bb3-4a4c-b782-12754e302464 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:23:21.590834 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-caa1f45a-0bb3-4a4c-b782-12754e302464 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7989dee4-521d-4275-876b-69d36e5ee0db] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:23:21.597354 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-caa1f45a-0bb3-4a4c-b782-12754e302464 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:21.597836 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-caa1f45a-0bb3-4a4c-b782-12754e302464 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:21.598265 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-caa1f45a-0bb3-4a4c-b782-12754e302464 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:21.598945 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-caa1f45a-0bb3-4a4c-b782-12754e302464 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:21.599394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-caa1f45a-0bb3-4a4c-b782-12754e302464 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:21.599845 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-caa1f45a-0bb3-4a4c-b782-12754e302464 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:21.612766 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-caa1f45a-0bb3-4a4c-b782-12754e302464 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] HTTP exception thrown: Instance 7989dee4-521d-4275-876b-69d36e5ee0db could not be found. Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-caa1f45a-0bb3-4a4c-b782-12754e302464 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Request method failure captured: Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db HTTP/1.1 Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMeyJZRqFuvQJtZCWeEfnTLoobGafQrCfCPsO4P3kFNSqgC_oGVkCFjcESaRqsFxJntPCuLvn0CRJys-Z4jXe9lWwUBW-K8AkD3c4hlFl8Gp5FHhlSDqADhXBJvw1R0N0TNS5JDfREF6NFtT1Mmi6CfIEMdwBZ9rsEumZd98Bw69578Y Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: 54bca4cc170d4e3fbad17be586081bc0 Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-TestVolumeBootPattern-437483383 Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:23:21.614394 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:23:21.616227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:23:21.616227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-TestVolumeBootPattern-437483383 Sep 26 18:23:21.616227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: 54bca4cc170d4e3fbad17be586081bc0 Sep 26 18:23:21.616227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-TestVolumeBootPattern-437483383 Sep 26 18:23:21.616227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-TestVolumeBootPattern-437483383-project Sep 26 18:23:21.616227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:23:21.616227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:23:21.616227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 8d96b8d565f94e68a705691a5ec64e04 Sep 26 18:23:21.616227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-TestVolumeBootPattern-437483383-project Sep 26 18:23:21.616227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:23:21.616227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance 7989dee4-521d-4275-876b-69d36e5ee0db could not be found. Sep 26 18:23:21.616227 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': '7989dee4-521d-4275-876b-69d36e5ee0db'} Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7989dee4-521d-4275-876b-69d36e5ee0db could not be found. Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:23:21.617154 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7989dee4-521d-4275-876b-69d36e5ee0db could not be found. Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7989dee4-521d-4275-876b-69d36e5ee0db could not be found. Sep 26 18:23:21.618584 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:23:21.619898 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-caa1f45a-0bb3-4a4c-b782-12754e302464 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Returning 404 to user: Instance 7989dee4-521d-4275-876b-69d36e5ee0db could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:23:21.619898 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-caa1f45a-0bb3-4a4c-b782-12754e302464 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db" status: 404 len: 111 microversion: 2.1 time: 0.029394 Sep 26 18:23:21.619898 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 610/1203] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:23:21 2022] GET /compute/v2.1/servers/7989dee4-521d-4275-876b-69d36e5ee0db => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:23:25.005425 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-0fd173d6-8cae-4f2d-aeb8-6e5b458c32cb tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:23:25.005960 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-0fd173d6-8cae-4f2d-aeb8-6e5b458c32cb tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:23:25.009237 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-905a77e5-ef91-4e8d-83a3-9ba1b367a523 req-ab798721-24d4-43bd-8301-01b8fbb6b867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee134731-9f42-49a9-85df-cc94e3c6ca02", "tag": "ab287099-77e4-4781-991d-6e39e2a3928a"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:23:25.012847 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0fd173d6-8cae-4f2d-aeb8-6e5b458c32cb tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:25.013337 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0fd173d6-8cae-4f2d-aeb8-6e5b458c32cb tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:25.013888 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0fd173d6-8cae-4f2d-aeb8-6e5b458c32cb tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:25.014457 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0fd173d6-8cae-4f2d-aeb8-6e5b458c32cb tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:25.014914 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0fd173d6-8cae-4f2d-aeb8-6e5b458c32cb tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:25.015499 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-0fd173d6-8cae-4f2d-aeb8-6e5b458c32cb tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:25.019612 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-905a77e5-ef91-4e8d-83a3-9ba1b367a523 req-ab798721-24d4-43bd-8301-01b8fbb6b867 service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:25.020123 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-905a77e5-ef91-4e8d-83a3-9ba1b367a523 req-ab798721-24d4-43bd-8301-01b8fbb6b867 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:25.020798 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-905a77e5-ef91-4e8d-83a3-9ba1b367a523 req-ab798721-24d4-43bd-8301-01b8fbb6b867 service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:25.032449 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-905a77e5-ef91-4e8d-83a3-9ba1b367a523 req-ab798721-24d4-43bd-8301-01b8fbb6b867 service nova] Creating event network-changed:ab287099-77e4-4781-991d-6e39e2a3928a for instance ee134731-9f42-49a9-85df-cc94e3c6ca02 on hv-cinder-85931 Sep 26 18:23:25.038043 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-905a77e5-ef91-4e8d-83a3-9ba1b367a523 req-ab798721-24d4-43bd-8301-01b8fbb6b867 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032882 Sep 26 18:23:25.039127 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 611/1204] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:23:25.043680 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-0fd173d6-8cae-4f2d-aeb8-6e5b458c32cb tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Going to try to terminate instance {{(pid=121028) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 18:23:25.373137 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-0fd173d6-8cae-4f2d-aeb8-6e5b458c32cb tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 204 len: 0 microversion: 2.1 time: 0.371334 Sep 26 18:23:25.378250 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 594/1205] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:23:24 2022] DELETE /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 18:23:25.383038 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-99f5d9f6-4000-471c-8d07-cd87823138da tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:23:25.383950 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-99f5d9f6-4000-471c-8d07-cd87823138da tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:23:25.390620 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-99f5d9f6-4000-471c-8d07-cd87823138da tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:25.391105 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-99f5d9f6-4000-471c-8d07-cd87823138da tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:25.391537 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-99f5d9f6-4000-471c-8d07-cd87823138da tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:25.392252 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-99f5d9f6-4000-471c-8d07-cd87823138da tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:25.392706 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-99f5d9f6-4000-471c-8d07-cd87823138da tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:25.393136 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-99f5d9f6-4000-471c-8d07-cd87823138da tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:25.534025 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-99f5d9f6-4000-471c-8d07-cd87823138da tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:23:25.541898 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-99f5d9f6-4000-471c-8d07-cd87823138da tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1575 microversion: 2.1 time: 0.163223 Sep 26 18:23:25.542463 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 612/1206] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:23:25 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:23:26.567176 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4086105a-a804-456b-9374-bfe0a990803b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:23:26.567816 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4086105a-a804-456b-9374-bfe0a990803b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:23:26.574402 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4086105a-a804-456b-9374-bfe0a990803b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:26.574870 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4086105a-a804-456b-9374-bfe0a990803b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:26.575313 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4086105a-a804-456b-9374-bfe0a990803b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:26.575995 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4086105a-a804-456b-9374-bfe0a990803b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:26.576444 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4086105a-a804-456b-9374-bfe0a990803b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:26.576855 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4086105a-a804-456b-9374-bfe0a990803b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:26.785061 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-4086105a-a804-456b-9374-bfe0a990803b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:23:26.792751 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4086105a-a804-456b-9374-bfe0a990803b tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1575 microversion: 2.1 time: 0.230648 Sep 26 18:23:26.793310 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 595/1207] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:23:26 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1575 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:23:27.547808 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [req-048145ff-63c5-4812-a157-8f65a0859b7e req-4235f2ab-89b6-4c36-bf97-cf1e3aed16ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee134731-9f42-49a9-85df-cc94e3c6ca02", "name": "network-vif-deleted", "tag": "ab287099-77e4-4781-991d-6e39e2a3928a"}]} {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 18:23:27.557549 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-048145ff-63c5-4812-a157-8f65a0859b7e req-4235f2ab-89b6-4c36-bf97-cf1e3aed16ea service nova] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:27.558061 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-048145ff-63c5-4812-a157-8f65a0859b7e req-4235f2ab-89b6-4c36-bf97-cf1e3aed16ea service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:27.558490 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [req-048145ff-63c5-4812-a157-8f65a0859b7e req-4235f2ab-89b6-4c36-bf97-cf1e3aed16ea service nova] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:27.569882 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.compute.server_external_events [req-048145ff-63c5-4812-a157-8f65a0859b7e req-4235f2ab-89b6-4c36-bf97-cf1e3aed16ea service nova] Creating event network-vif-deleted:ab287099-77e4-4781-991d-6e39e2a3928a for instance ee134731-9f42-49a9-85df-cc94e3c6ca02 on hv-cinder-85931 Sep 26 18:23:27.574767 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [req-048145ff-63c5-4812-a157-8f65a0859b7e req-4235f2ab-89b6-4c36-bf97-cf1e3aed16ea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030635 Sep 26 18:23:27.575344 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 613/1208] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Sep 26 18:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 18:23:27.819045 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-fc612166-ffb7-43c3-b655-4d0e551ff09e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:23:27.819897 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-fc612166-ffb7-43c3-b655-4d0e551ff09e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:23:27.827066 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fc612166-ffb7-43c3-b655-4d0e551ff09e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:27.827682 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fc612166-ffb7-43c3-b655-4d0e551ff09e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:27.828708 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fc612166-ffb7-43c3-b655-4d0e551ff09e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:27.829627 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fc612166-ffb7-43c3-b655-4d0e551ff09e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:27.830266 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fc612166-ffb7-43c3-b655-4d0e551ff09e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:27.830696 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-fc612166-ffb7-43c3-b655-4d0e551ff09e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:27.905776 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.policy [None req-fc612166-ffb7-43c3-b655-4d0e551ff09e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121028) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:23:27.914927 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-fc612166-ffb7-43c3-b655-4d0e551ff09e tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1389 microversion: 2.1 time: 0.099760 Sep 26 18:23:27.915507 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 596/1209] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:23:27 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1389 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:23:28.939433 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-988d4e76-1344-43e3-842c-b38a3909f156 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:23:28.940155 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-988d4e76-1344-43e3-842c-b38a3909f156 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:23:28.946231 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-988d4e76-1344-43e3-842c-b38a3909f156 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:28.946705 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-988d4e76-1344-43e3-842c-b38a3909f156 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:28.947148 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-988d4e76-1344-43e3-842c-b38a3909f156 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:28.947843 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-988d4e76-1344-43e3-842c-b38a3909f156 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:28.948292 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-988d4e76-1344-43e3-842c-b38a3909f156 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:28.948709 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-988d4e76-1344-43e3-842c-b38a3909f156 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:28.980284 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-988d4e76-1344-43e3-842c-b38a3909f156 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:28.980873 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-988d4e76-1344-43e3-842c-b38a3909f156 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:28.981308 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-988d4e76-1344-43e3-842c-b38a3909f156 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:28.981757 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.objects.instance [None req-988d4e76-1344-43e3-842c-b38a3909f156 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lazy-loading 'fault' on Instance uuid ee134731-9f42-49a9-85df-cc94e3c6ca02 {{(pid=121029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 18:23:29.024143 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.policy [None req-988d4e76-1344-43e3-842c-b38a3909f156 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96b8d565f94e68a705691a5ec64e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bca4cc170d4e3fbad17be586081bc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121029) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 18:23:29.032908 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-988d4e76-1344-43e3-842c-b38a3909f156 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 200 len: 1228 microversion: 2.1 time: 0.098179 Sep 26 18:23:29.033488 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 614/1210] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:23:28 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 1228 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 18:23:30.056376 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4014a3ce-7522-4397-8bed-20c4c71fa250 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:23:30.056999 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-4014a3ce-7522-4397-8bed-20c4c71fa250 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: ee134731-9f42-49a9-85df-cc94e3c6ca02] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:23:30.063538 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4014a3ce-7522-4397-8bed-20c4c71fa250 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:30.064049 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4014a3ce-7522-4397-8bed-20c4c71fa250 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:30.064486 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4014a3ce-7522-4397-8bed-20c4c71fa250 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:30.065172 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4014a3ce-7522-4397-8bed-20c4c71fa250 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:30.065629 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4014a3ce-7522-4397-8bed-20c4c71fa250 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:30.066054 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-4014a3ce-7522-4397-8bed-20c4c71fa250 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:30.079703 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-4014a3ce-7522-4397-8bed-20c4c71fa250 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] HTTP exception thrown: Instance ee134731-9f42-49a9-85df-cc94e3c6ca02 could not be found. Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4014a3ce-7522-4397-8bed-20c4c71fa250 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Request method failure captured: Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 HTTP/1.1 Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMeyJZRqFuvQJtZCWeEfnTLoobGafQrCfCPsO4P3kFNSqgC_oGVkCFjcESaRqsFxJntPCuLvn0CRJys-Z4jXe9lWwUBW-K8AkD3c4hlFl8Gp5FHhlSDqADhXBJvw1R0N0TNS5JDfREF6NFtT1Mmi6CfIEMdwBZ9rsEumZd98Bw69578Y Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 54bca4cc170d4e3fbad17be586081bc0 Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-TestVolumeBootPattern-437483383 Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:23:30.081336 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:23:30.083131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:23:30.083131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-TestVolumeBootPattern-437483383 Sep 26 18:23:30.083131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 54bca4cc170d4e3fbad17be586081bc0 Sep 26 18:23:30.083131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-TestVolumeBootPattern-437483383 Sep 26 18:23:30.083131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-TestVolumeBootPattern-437483383-project Sep 26 18:23:30.083131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:23:30.083131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:23:30.083131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 8d96b8d565f94e68a705691a5ec64e04 Sep 26 18:23:30.083131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-TestVolumeBootPattern-437483383-project Sep 26 18:23:30.083131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:23:30.083131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance ee134731-9f42-49a9-85df-cc94e3c6ca02 could not be found. Sep 26 18:23:30.083131 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': 'ee134731-9f42-49a9-85df-cc94e3c6ca02'} Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee134731-9f42-49a9-85df-cc94e3c6ca02 could not be found. Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:23:30.084239 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee134731-9f42-49a9-85df-cc94e3c6ca02 could not be found. Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee134731-9f42-49a9-85df-cc94e3c6ca02 could not be found. Sep 26 18:23:30.085884 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:23:30.087502 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-4014a3ce-7522-4397-8bed-20c4c71fa250 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Returning 404 to user: Instance ee134731-9f42-49a9-85df-cc94e3c6ca02 could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:23:30.087502 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-4014a3ce-7522-4397-8bed-20c4c71fa250 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02" status: 404 len: 111 microversion: 2.1 time: 0.030447 Sep 26 18:23:30.087502 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 597/1211] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:23:30 2022] GET /compute/v2.1/servers/ee134731-9f42-49a9-85df-cc94e3c6ca02 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:23:30.631776 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d02cbd62-86ed-4bfc-9091-bc5c143e1db4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:23:30.632314 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.compute.api [None req-d02cbd62-86ed-4bfc-9091-bc5c143e1db4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121029) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:23:30.639023 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d02cbd62-86ed-4bfc-9091-bc5c143e1db4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:30.639508 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d02cbd62-86ed-4bfc-9091-bc5c143e1db4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:30.640679 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d02cbd62-86ed-4bfc-9091-bc5c143e1db4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:30.641400 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d02cbd62-86ed-4bfc-9091-bc5c143e1db4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:30.641850 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d02cbd62-86ed-4bfc-9091-bc5c143e1db4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:30.642271 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG oslo_concurrency.lockutils [None req-d02cbd62-86ed-4bfc-9091-bc5c143e1db4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:30.656516 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.wsgi [None req-d02cbd62-86ed-4bfc-9091-bc5c143e1db4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] HTTP exception thrown: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d02cbd62-86ed-4bfc-9091-bc5c143e1db4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Request method failure captured: Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: request: DELETE /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 HTTP/1.1 Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept: application/json Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Accept-Encoding: identity Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Connection: close Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Length: 0 Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Content-Type: application/json Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Host: 10.222.0.67 Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: Openstack-System-Scope: None Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: User-Agent: python-urllib3/1.26.12 Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Auth-Token: gAAAAABjMeyJZRqFuvQJtZCWeEfnTLoobGafQrCfCPsO4P3kFNSqgC_oGVkCFjcESaRqsFxJntPCuLvn0CRJys-Z4jXe9lWwUBW-K8AkD3c4hlFl8Gp5FHhlSDqADhXBJvw1R0N0TNS5JDfREF6NFtT1Mmi6CfIEMdwBZ9rsEumZd98Bw69578Y Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Id: None Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Domain-Name: None Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Identity-Status: Confirmed Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Is-Admin-Project: True Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Id: default Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Domain-Name: Default Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Id: 54bca4cc170d4e3fbad17be586081bc0 Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Project-Name: tempest-TestVolumeBootPattern-437483383 Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Role: reader,member Sep 26 18:23:30.658145 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Roles: reader,member Sep 26 18:23:30.659930 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:23:30.659930 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant: tempest-TestVolumeBootPattern-437483383 Sep 26 18:23:30.659930 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Id: 54bca4cc170d4e3fbad17be586081bc0 Sep 26 18:23:30.659930 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-Tenant-Name: tempest-TestVolumeBootPattern-437483383 Sep 26 18:23:30.659930 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User: tempest-TestVolumeBootPattern-437483383-project Sep 26 18:23:30.659930 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Id: default Sep 26 18:23:30.659930 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Domain-Name: Default Sep 26 18:23:30.659930 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Id: 8d96b8d565f94e68a705691a5ec64e04 Sep 26 18:23:30.659930 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: X-User-Name: tempest-TestVolumeBootPattern-437483383-project Sep 26 18:23:30.659930 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: method: > Sep 26 18:23:30.659930 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: exception: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. Sep 26 18:23:30.659930 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: action_args: {'id': '7b9a3691-e877-45a2-9a0a-5f13beb60456'} Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:23:30.661016 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. Sep 26 18:23:30.662794 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: ERROR nova.api.openstack.wsgi Sep 26 18:23:30.664489 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-d02cbd62-86ed-4bfc-9091-bc5c143e1db4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Returning 404 to user: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. {{(pid=121029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:23:30.664489 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-d02cbd62-86ed-4bfc-9091-bc5c143e1db4 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 404 len: 111 microversion: 2.1 time: 0.031716 Sep 26 18:23:30.664489 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 615/1212] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Sep 26 18:23:30 2022] DELETE /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:23:30.669283 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ab311833-44ae-4969-a061-01fbdb8cfe86 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '>' {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:23:30.669970 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.compute.api [None req-ab311833-44ae-4969-a061-01fbdb8cfe86 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] [instance: 7b9a3691-e877-45a2-9a0a-5f13beb60456] Fetching instance by UUID {{(pid=121028) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 18:23:30.676830 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ab311833-44ae-4969-a061-01fbdb8cfe86 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:30.677390 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ab311833-44ae-4969-a061-01fbdb8cfe86 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:30.677898 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ab311833-44ae-4969-a061-01fbdb8cfe86 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:30.678675 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ab311833-44ae-4969-a061-01fbdb8cfe86 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Acquiring lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 18:23:30.679139 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ab311833-44ae-4969-a061-01fbdb8cfe86 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 18:23:30.679569 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG oslo_concurrency.lockutils [None req-ab311833-44ae-4969-a061-01fbdb8cfe86 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Lock "cd60df5b-c4b3-42ae-8ece-991fe5b02264" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 18:23:30.695513 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.wsgi [None req-ab311833-44ae-4969-a061-01fbdb8cfe86 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] HTTP exception thrown: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ab311833-44ae-4969-a061-01fbdb8cfe86 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Request method failure captured: Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: request: GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 HTTP/1.1 Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept: application/json Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Accept-Encoding: identity Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Connection: close Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Length: 0 Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Content-Type: application/json Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Host: 10.222.0.67 Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: Openstack-System-Scope: None Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: User-Agent: python-urllib3/1.26.12 Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Auth-Token: gAAAAABjMeyJZRqFuvQJtZCWeEfnTLoobGafQrCfCPsO4P3kFNSqgC_oGVkCFjcESaRqsFxJntPCuLvn0CRJys-Z4jXe9lWwUBW-K8AkD3c4hlFl8Gp5FHhlSDqADhXBJvw1R0N0TNS5JDfREF6NFtT1Mmi6CfIEMdwBZ9rsEumZd98Bw69578Y Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Id: None Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Domain-Name: None Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Identity-Status: Confirmed Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Is-Admin-Project: True Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Id: default Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Domain-Name: Default Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Id: 54bca4cc170d4e3fbad17be586081bc0 Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Project-Name: tempest-TestVolumeBootPattern-437483383 Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Role: reader,member Sep 26 18:23:30.697037 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Roles: reader,member Sep 26 18:23:30.698717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/54bca4cc170d4e3fbad17be586081bc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}] Sep 26 18:23:30.698717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant: tempest-TestVolumeBootPattern-437483383 Sep 26 18:23:30.698717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Id: 54bca4cc170d4e3fbad17be586081bc0 Sep 26 18:23:30.698717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-Tenant-Name: tempest-TestVolumeBootPattern-437483383 Sep 26 18:23:30.698717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User: tempest-TestVolumeBootPattern-437483383-project Sep 26 18:23:30.698717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Id: default Sep 26 18:23:30.698717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Domain-Name: Default Sep 26 18:23:30.698717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Id: 8d96b8d565f94e68a705691a5ec64e04 Sep 26 18:23:30.698717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: X-User-Name: tempest-TestVolumeBootPattern-437483383-project Sep 26 18:23:30.698717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: method: > Sep 26 18:23:30.698717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: exception: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. Sep 26 18:23:30.698717 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: action_args: {'id': '7b9a3691-e877-45a2-9a0a-5f13beb60456'} Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: {{(pid=121028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 18:23:30.699786 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. Sep 26 18:23:30.701126 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: ERROR nova.api.openstack.wsgi Sep 26 18:23:30.702399 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: DEBUG nova.api.openstack.wsgi [None req-ab311833-44ae-4969-a061-01fbdb8cfe86 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Returning 404 to user: Instance 7b9a3691-e877-45a2-9a0a-5f13beb60456 could not be found. {{(pid=121028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 18:23:30.702399 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: INFO nova.api.openstack.requestlog [None req-ab311833-44ae-4969-a061-01fbdb8cfe86 tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456" status: 404 len: 111 microversion: 2.1 time: 0.033450 Sep 26 18:23:30.702399 dv-cinder-859319-1-iscsi devstack@n-api.service[121028]: [pid: 121028|app: 0|req: 598/1213] 10.222.0.67 () {58 vars in 1236 bytes} [Mon Sep 26 18:23:30 2022] GET /compute/v2.1/servers/7b9a3691-e877-45a2-9a0a-5f13beb60456 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 18:23:32.219940 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: DEBUG nova.api.openstack.wsgi [None req-7f4233b4-4ea7-4978-821b-207b3e06b99c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] Calling method '.version_select at 0x7f3a74bdc280>' {{(pid=121029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 18:23:32.324031 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: INFO nova.api.openstack.requestlog [None req-7f4233b4-4ea7-4978-821b-207b3e06b99c tempest-TestVolumeBootPattern-437483383 tempest-TestVolumeBootPattern-437483383-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-7185126" status: 202 len: 0 microversion: 2.1 time: 0.109761 Sep 26 18:23:32.324679 dv-cinder-859319-1-iscsi devstack@n-api.service[121029]: [pid: 121029|app: 0|req: 616/1214] 10.222.0.67 () {58 vars in 1254 bytes} [Mon Sep 26 18:23:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-7185126 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)